2022-08-23T22:34:05,519 Created temporary directory: /tmp/pip-ephem-wheel-cache-vf0eqg6q 2022-08-23T22:34:05,524 Created temporary directory: /tmp/pip-build-tracker-asb2i8a0 2022-08-23T22:34:05,525 Initialized build tracking at /tmp/pip-build-tracker-asb2i8a0 2022-08-23T22:34:05,525 Created build tracker: /tmp/pip-build-tracker-asb2i8a0 2022-08-23T22:34:05,526 Entered build tracker: /tmp/pip-build-tracker-asb2i8a0 2022-08-23T22:34:05,527 Created temporary directory: /tmp/pip-wheel-h_tuer4t 2022-08-23T22:34:05,596 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2022-08-23T22:34:05,604 2 location(s) to search for versions of wrds2pg: 2022-08-23T22:34:05,604 * https://pypi.org/simple/wrds2pg/ 2022-08-23T22:34:05,604 * https://www.piwheels.org/simple/wrds2pg/ 2022-08-23T22:34:05,605 Fetching project page and analyzing links: https://pypi.org/simple/wrds2pg/ 2022-08-23T22:34:05,606 Getting page https://pypi.org/simple/wrds2pg/ 2022-08-23T22:34:05,609 Found index url https://pypi.org/simple 2022-08-23T22:34:05,821 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/36/4d/10bef13832bdc17990beac4a20b47a77976768547aa4bd6137cbafd46f83/wrds2pg-0.1.17-py3-none-any.whl#sha256=3471efec23d7b15c86751d79adc43cb425d7ad46016afc247f1e1992b78083b9 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,822 Found link https://files.pythonhosted.org/packages/ae/9c/ee0b12002821c2c8e21625c915081fc315d9f1ceef100cb330e9116f2d0d/wrds2pg-0.1.17.tar.gz#sha256=665c4fb5c4dcc9f3553eb144053f334ea76e1721b65a96b438fc5a3f78719ef1 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.17 2022-08-23T22:34:05,823 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/ac/24/35ec84d1b765955286a326d0f0c98423730b5818f33c5cdc3e2a2d528adf/wrds2pg-0.1.18-py3-none-any.whl#sha256=896ccb2badb2923b55bb6fbe62a8d74604733c8c9c0181b144e2e2f9aabb629c (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,825 Found link https://files.pythonhosted.org/packages/dd/4f/6c631513b90802ad1fae0c3fb3dbf65efc603d3fee00a1cae4af45f6b2c5/wrds2pg-0.1.18.tar.gz#sha256=7dc2949f1891c602c81f795369c5bd3c72fd257370306eca459e7330e0874988 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.18 2022-08-23T22:34:05,825 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/42/1a/cbdac7035e9b7836ed96c6a9e493b556d3f595245c4f0b239c9ba639d53e/wrds2pg-0.1.20-py3-none-any.whl#sha256=bdca9bdaa2e54c59f2120c519804dc52bf271a35e03a80dd8b1f65f961f28ff6 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,827 Found link https://files.pythonhosted.org/packages/14/81/4c94b875ec21dccdefb6a1846bc4f4d4a6a529a0a6921cbbf580e07f8b6b/wrds2pg-0.1.20.tar.gz#sha256=a9b86e50a278a821f4d1faa3f52312e3e557c332ab234b32def5e10f6afc00ae (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.20 2022-08-23T22:34:05,828 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/e7/a1/192e3bf4b1e122d0b12a094f4ee4fd1667276cb87cbe5d0a53412dc1a9bc/wrds2pg-0.1.21-py3-none-any.whl#sha256=f9ab26b51603e3bf82196a52410a990d95685ee6bedc4a88572340686d09affc (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,829 Found link https://files.pythonhosted.org/packages/4d/4c/5fa9cc2e936e16d0be4a56ce2e8cf03b3ba0f59f49afdebd29f1eda99df4/wrds2pg-0.1.21.tar.gz#sha256=9c3f4e0e21d09ab93555e04c410b5292cf2c89ce2407015de3b289cd943f79ff (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.21 2022-08-23T22:34:05,830 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/4a/52/d9134119b39cf9e939e7cc5ab1317627406af4229fcbdf1085df366e01b4/wrds2pg-0.1.22-py3-none-any.whl#sha256=bfa8fbfc09819fe5524153f82e6fc631069dab5096b0013b03aae5600346a2ab (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,831 Found link https://files.pythonhosted.org/packages/5b/db/ebbf903d32ac113cdd0b3637f1e5dc37a4abf9f63f18dd56835f3611a465/wrds2pg-0.1.22.tar.gz#sha256=9925b6c217bf8c9cf1fa17f6fc08a720b3849b4e95507cf2a905b06536c60ea3 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.22 2022-08-23T22:34:05,832 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/c9/47/a040be2f7d67c120396a27beb1f5e3a6eb97fd24e17cd485ec6d332dad6e/wrds2pg-0.1.23-py3-none-any.whl#sha256=24b5f15364dc798de6d21d3f2d117ce1d7c6e6e0768e8268e7b196943d36d1bd (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,833 Found link https://files.pythonhosted.org/packages/4e/aa/b4f4227ff1d464462f243592bddd638d07e886aa39018ef2bb486624e2f5/wrds2pg-0.1.23.tar.gz#sha256=29557ea7e669dfe1d2f0d4ac9966427698e8369922445e8ca03cc29fd4ff3adb (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.23 2022-08-23T22:34:05,834 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/7b/bf/a713b52aff61a20e5e9d851a69d7c4936d14018ed62759dd78629bfe12cf/wrds2pg-0.1.24-py3-none-any.whl#sha256=8bfd551d615500576f778b977f5771b5011d87a962c1d43e8b7aae7c42f6bafb (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,835 Found link https://files.pythonhosted.org/packages/ca/e9/81095cbac75110e7f53e915ebee06a9925bb32b6d8a307c7a709f9b74dd5/wrds2pg-0.1.24.tar.gz#sha256=b5fdbfe9ab1af360a872257987b354d05998a5e0ee0aefaafe7333787ebc1f16 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.24 2022-08-23T22:34:05,836 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/01/5d/cfd9a9cfe8194d52e16c24ef053b49225e85f0996c471226fc0cf5522e31/wrds2pg-1.0.0-py3-none-any.whl#sha256=89d17b1aae3ffc78c0c02e87a2f663b83648460da7a8406027d62ae7c9ceb164 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,837 Found link https://files.pythonhosted.org/packages/af/8f/069eed28514231a859da3b110112a0b2078f2c879e3cc5489909982ef2af/wrds2pg-1.0.0.tar.gz#sha256=138924033c17e35fc37dcff72df18398b1152fde1c803f34aa641adc72cb3f66 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.0 2022-08-23T22:34:05,838 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/90/3d/1fc327c68c63a7540a964879a5a124e9104c5a80cd058a5f0659d2945dd5/wrds2pg-1.0.2-py3-none-any.whl#sha256=73be788eb7aee9fce430717615f683c7f912a817238a33697f41f26b85726147 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,839 Found link https://files.pythonhosted.org/packages/fa/b0/49292467a2256c3ecdd7e7fdbd1c4729386bddc06f3a986483a311539f2b/wrds2pg-1.0.2.tar.gz#sha256=13c64ea0b23fd000ccc6f712a448a4c1e49879f9d3d645c58d56cbba9cdc99f8 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.2 2022-08-23T22:34:05,840 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/41/99/2866d67e2fcd10684ccc913eaa896ebcc00c60982133a5adfaa8a39b7aa1/wrds2pg-1.0.3-py3-none-any.whl#sha256=12de805441cbd63af3d66e6a2c651f8f7d15e77dc5c3714035cd450ea1708785 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,841 Found link https://files.pythonhosted.org/packages/0f/bf/b1032fff1645c597e292ac8d588c33bad73ca567c01e52fb149f4aa503d1/wrds2pg-1.0.3.tar.gz#sha256=ebef3b91951fd78a9e3dd51c212c119c8639c03f70aa7c4a273733240fd628fc (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.3 2022-08-23T22:34:05,842 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/0b/6c/bc13811b3a339ec1455a10a03b077d0a7fc7e43b3311201abbfc67d77fde/wrds2pg-1.0.4-py3-none-any.whl#sha256=8197d920152df0686f6cd8ca31af2f46820802334c63a0991ca0ddd1c215c909 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,843 Found link https://files.pythonhosted.org/packages/dc/f4/166d8822216116c22615377ab6493a7c44bd205b8853ae2b0ad51792d9e6/wrds2pg-1.0.4.tar.gz#sha256=e5f9ea4cf47eff9e5062815816f8ae257a9fc0370968f7a6802a0614a8d7a025 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.4 2022-08-23T22:34:05,844 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/78/a7/afce414cb2df44692f2dd5af0e28578c349e337110fb7c73b893cef3c048/wrds2pg-1.0.5-py3-none-any.whl#sha256=21abfd3fabf17eba315d7110979b9ed42f54051f205d859da68568b4699e291b (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,845 Found link https://files.pythonhosted.org/packages/64/a7/18d7edab1e04462bf1aafd2fe6ffc9132f0aa11be6daaf14927c532b73d3/wrds2pg-1.0.5.tar.gz#sha256=bfbd1a931b790209f96b1bd1c45d268ca714b051a65d4d06f51a2bca414674dd (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.5 2022-08-23T22:34:05,846 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/2b/8f/02f345286a6b878468948ab7bc6a56026077f0cbfb25d11440284519ba7a/wrds2pg-1.0.6-py3-none-any.whl#sha256=ba63b46b31e7f735db37bebf8ad301e976085a10628fcb01be40dbc9325267f9 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,847 Found link https://files.pythonhosted.org/packages/8c/06/abb4c39f3e3f730fffe349e03e1172e31c95fbb9edf4c9257bfb0b6e2c62/wrds2pg-1.0.6.tar.gz#sha256=33efcef845f9d47adb892052a2865ecb6dafb9541ead49a97840a0659d76ca91 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.6 2022-08-23T22:34:05,848 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/3f/b5/99b90fee6aaf0b150803cfbd6d86e0052d292257dd101e803df4d945ad7b/wrds2pg-1.0.8-py3-none-any.whl#sha256=4bca52110d40065aada2ca48ed090ab85a34add55c09c804f9586fd454ae3205 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,849 Found link https://files.pythonhosted.org/packages/eb/9f/a506b309ee9299d4d9cd3f5c1407e05da30c09cbbe8acf67e60de11a1b4e/wrds2pg-1.0.8.tar.gz#sha256=d5b5e5e738d01c7509660b839c8a949ff5210a81eedd2b514f8bdfa044752e96 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.8 2022-08-23T22:34:05,850 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/80/6d/34291718af062c4c329fbaeaaa582e011da15ce1193364f668581c3bd983/wrds2pg-1.0.9-py3-none-any.whl#sha256=31c6a2598fe8d8b97d73bcad19025da0249d8c835873e8ae12504bb585268cd0 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,851 Found link https://files.pythonhosted.org/packages/27/20/2b9788aef9e54ea3d590a456caa294d1c177fd05029e8f70b99022369f68/wrds2pg-1.0.9.tar.gz#sha256=abb716e343d49a455f949c7c87c1a08a0748f1233917d4b9282df55245bdca6c (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.9 2022-08-23T22:34:05,852 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/99/ac/4d765cf6d5048798219506138f491e7218d56226bd1d4a1ab994e5efcf33/wrds2pg-1.0.10-py3-none-any.whl#sha256=4cbc316d1697609c4af2a88bd009097590ac1d233739addce04b45ce6d365d3f (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,853 Found link https://files.pythonhosted.org/packages/f4/6a/630cd948c36f331db42c9bac9e414e721e779efbb692210419563d9f4ec1/wrds2pg-1.0.10.tar.gz#sha256=7e277d2c16c0547559c61e58764e40265bb10673f7c0a5e0e1feb543c2b46f75 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.10 2022-08-23T22:34:05,854 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/4b/8f/7a43a074a7f9fb3b14acbe6a7fdfe50e99d8489334adcc941ed6b4ca328b/wrds2pg-1.0.11-py3-none-any.whl#sha256=c42398fe36363172c42dc4cc17f92a29234b3837ec576a62f122ec5d10ef7dc9 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,855 Found link https://files.pythonhosted.org/packages/e8/2b/f8c9e8ea4d651a9e15946e91b9f1708582a8631b6a76ddb16ad9275bb7a5/wrds2pg-1.0.11.tar.gz#sha256=7371b4a232b33a07a33e39d1a92bf8ace7f1af3ce104af102ed5ddfbde1d3959 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.11 2022-08-23T22:34:05,856 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/20/62/e4cff4d188653aa99e511ec9db794706d3e0eca3a072847c47b59fb281ba/wrds2pg-1.0.12-py3-none-any.whl#sha256=33a2f3d0156a87919e55a66512709ebd5342ba3922a963883f45f0293485f68c (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,858 Found link https://files.pythonhosted.org/packages/14/9c/6db066ea90188c63fbacdfb53d2efd52e3ffb2f86ac229616b5ded27dabb/wrds2pg-1.0.12.tar.gz#sha256=ebd666351f2854fbcea52abff74b39ca505b3da2e872156932a0fa466444b80f (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.12 2022-08-23T22:34:05,858 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/00/0d/9122175d258c706db78ca1df2f46092a8f7caf9b85bb55fbb05bf8149b43/wrds2pg-1.0.13-py3-none-any.whl#sha256=0e2375216edb1e4f2641e1e3d0b567439e2044aa27606f0b91148e00e8ecca9e (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,860 Found link https://files.pythonhosted.org/packages/21/32/ed7df674875559e6afaacdfe2a846a78e88355b187349fb0890a00a9c87b/wrds2pg-1.0.13.tar.gz#sha256=655e4f5e61fde4a131bf058a65953b706b6f8cb6a068b598fd4611077d4f8daf (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.13 2022-08-23T22:34:05,860 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/98/27/a36bbe15df3fdbcf27a96e7a5b5f48c13d379465e4daf4889b5fd556eea0/wrds2pg-1.0.14-py3-none-any.whl#sha256=1d0af0fd088a917d0fc6a4349b2c00a7a00aa785ffffacfec43e947559edd888 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:05,862 Found link https://files.pythonhosted.org/packages/30/5c/79161fc26f5a5c96b45c5d9f96c49164b7e32ff106d04ba0e6bf2e321b05/wrds2pg-1.0.14.tar.gz#sha256=1cc2bf21404aeb497da0fcd7d4463f95000888a138f0b1169c5898ea1468ec49 (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.14 2022-08-23T22:34:05,863 Fetching project page and analyzing links: https://www.piwheels.org/simple/wrds2pg/ 2022-08-23T22:34:05,863 Getting page https://www.piwheels.org/simple/wrds2pg/ 2022-08-23T22:34:05,865 Found index url https://www.piwheels.org/simple 2022-08-23T22:34:06,079 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.13-py3-none-any.whl#sha256=dbb6b8140842cdf6dd074f31a847e5a7d6901706af211e0aff676dfb0a2dc5d5 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,080 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.12-py3-none-any.whl#sha256=a49ec8094e122aa39eaf87b3eaf04951ba358b7de814db7232d3d23db0ee7321 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,081 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.11-py3-none-any.whl#sha256=10c887b1d51113a546d42a5ff5c773acceb67e44b4dbc7f2c8e185e146bdbe3b (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,081 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.10-py3-none-any.whl#sha256=d7a91f736c8b935d21aaef6d5b729044c3b27fa3fe740e21bf54aeece56e3f13 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,082 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.9-py3-none-any.whl#sha256=544627010f3f3125f38a8b442475cb841a1e7b63e9644d7ed1c98245e5e8ffeb (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,082 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.8-py3-none-any.whl#sha256=4bca52110d40065aada2ca48ed090ab85a34add55c09c804f9586fd454ae3205 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,083 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.6-py3-none-any.whl#sha256=ba63b46b31e7f735db37bebf8ad301e976085a10628fcb01be40dbc9325267f9 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,084 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.5-py3-none-any.whl#sha256=21abfd3fabf17eba315d7110979b9ed42f54051f205d859da68568b4699e291b (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,084 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.4-py3-none-any.whl#sha256=8197d920152df0686f6cd8ca31af2f46820802334c63a0991ca0ddd1c215c909 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,085 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.3-py3-none-any.whl#sha256=12de805441cbd63af3d66e6a2c651f8f7d15e77dc5c3714035cd450ea1708785 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,085 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.2-py3-none-any.whl#sha256=73be788eb7aee9fce430717615f683c7f912a817238a33697f41f26b85726147 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,086 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.0-py3-none-any.whl#sha256=89d17b1aae3ffc78c0c02e87a2f663b83648460da7a8406027d62ae7c9ceb164 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,086 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.24-py3-none-any.whl#sha256=8bfd551d615500576f778b977f5771b5011d87a962c1d43e8b7aae7c42f6bafb (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,087 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.23-py3-none-any.whl#sha256=24b5f15364dc798de6d21d3f2d117ce1d7c6e6e0768e8268e7b196943d36d1bd (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,087 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.22-py3-none-any.whl#sha256=bfa8fbfc09819fe5524153f82e6fc631069dab5096b0013b03aae5600346a2ab (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,088 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.21-py3-none-any.whl#sha256=f9ab26b51603e3bf82196a52410a990d95685ee6bedc4a88572340686d09affc (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,089 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.20-py3-none-any.whl#sha256=bdca9bdaa2e54c59f2120c519804dc52bf271a35e03a80dd8b1f65f961f28ff6 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,089 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.18-py3-none-any.whl#sha256=896ccb2badb2923b55bb6fbe62a8d74604733c8c9c0181b144e2e2f9aabb629c (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,090 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.17-py3-none-any.whl#sha256=3471efec23d7b15c86751d79adc43cb425d7ad46016afc247f1e1992b78083b9 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2022-08-23T22:34:06,090 Skipping link: not a file: https://www.piwheels.org/simple/wrds2pg/ 2022-08-23T22:34:06,091 Skipping link: not a file: https://pypi.org/simple/wrds2pg/ 2022-08-23T22:34:06,131 Given no hashes to check 1 links for project 'wrds2pg': discarding no candidates 2022-08-23T22:34:06,162 Collecting wrds2pg==1.0.14 2022-08-23T22:34:06,167 Created temporary directory: /tmp/pip-unpack-xlgwzqrj 2022-08-23T22:34:06,395 Downloading wrds2pg-1.0.14.tar.gz (11 kB) 2022-08-23T22:34:06,479 Added wrds2pg==1.0.14 from https://files.pythonhosted.org/packages/30/5c/79161fc26f5a5c96b45c5d9f96c49164b7e32ff106d04ba0e6bf2e321b05/wrds2pg-1.0.14.tar.gz#sha256=1cc2bf21404aeb497da0fcd7d4463f95000888a138f0b1169c5898ea1468ec49 to build tracker '/tmp/pip-build-tracker-asb2i8a0' 2022-08-23T22:34:06,488 Created temporary directory: /tmp/pip-build-env-jlqglub4 2022-08-23T22:34:06,502 Created temporary directory: /tmp/pip-standalone-pip-wegniwgc 2022-08-23T22:34:08,821 Installing build dependencies: started 2022-08-23T22:34:08,824 Running command pip subprocess to install build dependencies 2022-08-23T22:34:18,412 Using pip 22.1.2 from /tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip (python 3.7) 2022-08-23T22:34:19,898 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2022-08-23T22:34:24,134 Collecting setuptools>=42 2022-08-23T22:34:24,400 Using cached https://www.piwheels.org/simple/setuptools/setuptools-65.2.0-py3-none-any.whl (1.2 MB) 2022-08-23T22:34:25,065 Collecting wheel 2022-08-23T22:34:25,098 Using cached https://www.piwheels.org/simple/wheel/wheel-0.37.1-py2.py3-none-any.whl (35 kB) 2022-08-23T22:34:31,011 Installing collected packages: wheel, setuptools 2022-08-23T22:34:31,291 Creating /tmp/pip-build-env-jlqglub4/overlay/bin 2022-08-23T22:34:31,295 changing mode of /tmp/pip-build-env-jlqglub4/overlay/bin/wheel to 755 2022-08-23T22:34:36,168 Successfully installed setuptools-65.2.0 wheel-0.37.1 2022-08-23T22:34:36,395 --- Logging error --- 2022-08-23T22:34:36,396 Traceback (most recent call last): 2022-08-23T22:34:36,396 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_internal/utils/logging.py", line 177, in emit 2022-08-23T22:34:36,396 self.console.print(renderable, overflow="ignore", crop=False, style=style) 2022-08-23T22:34:36,397 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_vendor/rich/console.py", line 1752, in print 2022-08-23T22:34:36,397 extend(render(renderable, render_options)) 2022-08-23T22:34:36,397 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_vendor/rich/console.py", line 1390, in render 2022-08-23T22:34:36,398 for render_output in iter_render: 2022-08-23T22:34:36,398 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_internal/utils/logging.py", line 134, in __rich_console__ 2022-08-23T22:34:36,398 for line in lines: 2022-08-23T22:34:36,399 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_vendor/rich/segment.py", line 245, in split_lines 2022-08-23T22:34:36,399 for segment in segments: 2022-08-23T22:34:36,399 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_vendor/rich/console.py", line 1368, in render 2022-08-23T22:34:36,400 renderable = rich_cast(renderable) 2022-08-23T22:34:36,400 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_vendor/rich/protocol.py", line 36, in rich_cast 2022-08-23T22:34:36,400 renderable = cast_method() 2022-08-23T22:34:36,401 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_internal/self_outdated_check.py", line 130, in __rich__ 2022-08-23T22:34:36,401 pip_cmd = get_best_invocation_for_this_pip() 2022-08-23T22:34:36,401 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_internal/utils/entrypoints.py", line 60, in get_best_invocation_for_this_pip 2022-08-23T22:34:36,402 os.path.join(binary_prefix, exe_name), 2022-08-23T22:34:36,402 File "/usr/lib/python3.7/genericpath.py", line 97, in samefile 2022-08-23T22:34:36,402 s2 = os.stat(f2) 2022-08-23T22:34:36,403 FileNotFoundError: [Errno 2] No such file or directory: '/usr/bin/pip3.7' 2022-08-23T22:34:36,403 Call stack: 2022-08-23T22:34:36,403 File "/usr/lib/python3.7/runpy.py", line 193, in _run_module_as_main 2022-08-23T22:34:36,404 "__main__", mod_spec) 2022-08-23T22:34:36,404 File "/usr/lib/python3.7/runpy.py", line 85, in _run_code 2022-08-23T22:34:36,405 exec(code, run_globals) 2022-08-23T22:34:36,405 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/__main__.py", line 31, in 2022-08-23T22:34:36,405 sys.exit(_main()) 2022-08-23T22:34:36,406 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_internal/cli/main.py", line 70, in main 2022-08-23T22:34:36,406 return command.main(cmd_args) 2022-08-23T22:34:36,406 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_internal/cli/base_command.py", line 101, in main 2022-08-23T22:34:36,406 return self._main(args) 2022-08-23T22:34:36,407 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_internal/cli/base_command.py", line 223, in _main 2022-08-23T22:34:36,407 self.handle_pip_version_check(options) 2022-08-23T22:34:36,407 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_internal/cli/req_command.py", line 148, in handle_pip_version_check 2022-08-23T22:34:36,408 pip_self_version_check(session, options) 2022-08-23T22:34:36,408 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_internal/self_outdated_check.py", line 237, in pip_self_version_check 2022-08-23T22:34:36,408 logger.info("[present-rich] %s", upgrade_prompt) 2022-08-23T22:34:36,409 File "/usr/lib/python3.7/logging/__init__.py", line 1383, in info 2022-08-23T22:34:36,409 self._log(INFO, msg, args, **kwargs) 2022-08-23T22:34:36,409 File "/usr/lib/python3.7/logging/__init__.py", line 1519, in _log 2022-08-23T22:34:36,410 self.handle(record) 2022-08-23T22:34:36,410 File "/usr/lib/python3.7/logging/__init__.py", line 1529, in handle 2022-08-23T22:34:36,410 self.callHandlers(record) 2022-08-23T22:34:36,411 File "/usr/lib/python3.7/logging/__init__.py", line 1591, in callHandlers 2022-08-23T22:34:36,411 hdlr.handle(record) 2022-08-23T22:34:36,411 File "/usr/lib/python3.7/logging/__init__.py", line 905, in handle 2022-08-23T22:34:36,411 self.emit(record) 2022-08-23T22:34:36,412 File "/tmp/pip-standalone-pip-wegniwgc/__env_pip__.zip/pip/_internal/utils/logging.py", line 179, in emit 2022-08-23T22:34:36,412 self.handleError(record) 2022-08-23T22:34:36,412 Message: '[present-rich] %s' 2022-08-23T22:34:36,413 Arguments: (UpgradePrompt(old='22.1.2', new='22.2.2'),) 2022-08-23T22:34:36,862 Installing build dependencies: finished with status 'done' 2022-08-23T22:34:36,890 Getting requirements to build wheel: started 2022-08-23T22:34:36,892 Running command Getting requirements to build wheel 2022-08-23T22:34:43,219 # WRDS (or SAS) to PostgreSQL 2022-08-23T22:34:43,220 This software has two functions: 2022-08-23T22:34:43,220 - Download tables from [WRDS](https://wrds-web.wharton.upenn.edu/wrds/) and feed them to a PostgreSQL database. (Requires access to WRDS and to the data in question.) 2022-08-23T22:34:43,221 - Import a SAS file (`*.sas7dbat`) into a PostgreSQL database. 2022-08-23T22:34:43,221 ## Requirements 2022-08-23T22:34:43,222 ### 1. Python 2022-08-23T22:34:43,222 The software uses Python 3 and depends on Pandas, SQLAlchemy and Paramiko. In addition, the Python scripts generally interact with PostgreSQL using SQLAlchemy and the [Psycopg](http://initd.org/psycopg/) library. 2022-08-23T22:34:43,223 These dependencies are installed when you use Pip (see instructions below). 2022-08-23T22:34:43,223 ### 2. A WRDS ID 2022-08-23T22:34:43,224 To use public-key authentication to access WRDS, follow hints taken from [here](https://debian-administration.org/article/152/Password-less_logins_with_OpenSSH) to set up a public key. 2022-08-23T22:34:43,224 Copy that key to the WRDS server from the terminal on your computer. 2022-08-23T22:34:43,224 (Note that this code assumes you have a directory `.ssh` in your home directory. If not, log into WRDS via SSH, then type `mkdir ~/.ssh` to create this.) 2022-08-23T22:34:43,225 Here's code (for me) to create the key and send it to WRDS: 2022-08-23T22:34:43,225 ``` 2022-08-23T22:34:43,225 ssh-keygen -t rsa 2022-08-23T22:34:43,226 cat ~/.ssh/id_rsa.pub | ssh iangow@wrds-cloud.wharton.upenn.edu "cat >> ~/.ssh/authorized_keys" 2022-08-23T22:34:43,226 ``` 2022-08-23T22:34:43,227 Use an empty passphrase in setting up the key so that the scripts can run without user intervention. 2022-08-23T22:34:43,227 ### 3. PostgreSQL 2022-08-23T22:34:43,227 You should have a PostgreSQL database to store the data. 2022-08-23T22:34:43,228 ### 4. Environment variables 2022-08-23T22:34:43,229 Environment variables that the code can use include: 2022-08-23T22:34:43,229 - `PGDATABASE`: The name of the PostgreSQL database you use. 2022-08-23T22:34:43,230 - `PGUSER`: Your username on the PostgreSQL database. 2022-08-23T22:34:43,230 - `PGHOST`: Where the PostgreSQL database is to be found (this will be `localhost` if its on the same machine as you're running the code on) 2022-08-23T22:34:43,230 - `WRDS_ID`: Your [WRDS](https://wrds-web.wharton.upenn.edu/wrds/) ID. 2022-08-23T22:34:43,231 I set these environment variables in `~/.profile`: 2022-08-23T22:34:43,231 ``` 2022-08-23T22:34:43,232 export PGHOST="localhost" 2022-08-23T22:34:43,232 export PGDATABASE="crsp" 2022-08-23T22:34:43,232 export WRDS_ID="iangow" 2022-08-23T22:34:43,233 export PGUSER="igow" 2022-08-23T22:34:43,233 ``` 2022-08-23T22:34:43,234 ## Using the function `wrds_update`. 2022-08-23T22:34:43,234 Two arguments `table_name` and `schema` are required. 2022-08-23T22:34:43,235 ### 1. WRDS Settings 2022-08-23T22:34:43,235 Set `WRDS_ID` using either `wrds_id=your_wrds_id` in the function call or the environment variable `WRDS_ID`. 2022-08-23T22:34:43,236 ### 2. Environment variables 2022-08-23T22:34:43,236 The software will use the environment variables `PGHOST`, `PGDATABASE`, and `PGUSER` if you If you have set them. Otherwise, you need to provide values as arguments to `wrds_udpate()`. Default `PGPORT` is`5432`. 2022-08-23T22:34:43,237 ### 3. Table settings 2022-08-23T22:34:43,237 To tailor your request, specify the following arguments: 2022-08-23T22:34:43,238 - `fix_missing`: set to `True` to fix missing values. This addresses special missign values, which SAS's `PROC EXPORT` dumps as strings. Default value is `False`. 2022-08-23T22:34:43,238 - `fix_cr`: set to `True` to fix characters. Default value is `False`. 2022-08-23T22:34:43,238 - `drop`: add column names to be dropped (e.g., `drop="id name"` will drop columns `id` and `name`). 2022-08-23T22:34:43,239 - `obs`: add maxium number of observations (e.g., `obs=10` will import the first 10 rows from the table on WRDS). 2022-08-23T22:34:43,239 - `rename`: rename columns (e.g., `rename="fee=mngt_fee"` renames `fee` to `mngt_fee`). 2022-08-23T22:34:43,239 - `force`: set to `True` to force update. Default value is `False`. 2022-08-23T22:34:43,240 ## Importing SAS data into PostgreSQL 2022-08-23T22:34:43,240 The software can also upload SAS file directly to PostgreSQL. 2022-08-23T22:34:43,241 You need to have local SAS in order to use this function. 2022-08-23T22:34:43,241 Use `fpath` to specify the path to the file to be imported 2022-08-23T22:34:43,242 ### Examples 2022-08-23T22:34:43,242 Here are some examples. 2022-08-23T22:34:43,243 If you are at the home directory of this git repo, you can import and use the software as shown below. 2022-08-23T22:34:43,243 To install it from Github: 2022-08-23T22:34:43,244 ``` 2022-08-23T22:34:43,244 sudo -H pip3 install git+https://github.com/iangow/wrds2pg --upgrade 2022-08-23T22:34:43,245 ``` 2022-08-23T22:34:43,245 This software is also available from PyPI. To install it from [PyPI](https://pypi.org/project/wrds2pg/): 2022-08-23T22:34:43,245 ``` 2022-08-23T22:34:43,246 pip3 install wrds2pg 2022-08-23T22:34:43,246 ``` 2022-08-23T22:34:43,246 Example usage: 2022-08-23T22:34:43,247 ```py 2022-08-23T22:34:43,247 from wrds2pg import wrds_update 2022-08-23T22:34:43,248 # 1. Download crsp.mcti from wrds and upload to pg as crps.mcti 2022-08-23T22:34:43,248 # Simplest version 2022-08-23T22:34:43,248 wrds_update(table_name="mcti", schema="crsp") 2022-08-23T22:34:43,249 # Tailored arguments 2022-08-23T22:34:43,249 wrds_update(table_name="mcti", schema="crsp", host=your_pghost, 2022-08-23T22:34:43,249 dbname=your_pg_database, 2022-08-23T22:34:43,250 fix_missing=True, fix_cr=True, drop="b30ret b30ind", obs=10, 2022-08-23T22:34:43,250 rename="caldt=calendar_date", force=True) 2022-08-23T22:34:43,251 # 2. Upload test.sas7dbat to pg as crsp.mcti 2022-08-23T22:34:43,251 wrds_update(table_name="mcti", schema="crsp", fpath="your_path/test.sas7dbat") 2022-08-23T22:34:43,251 ``` 2022-08-23T22:34:43,252 ### Report bugs 2022-08-23T22:34:43,252 Author: Ian Gow, 2022-08-23T22:34:43,253 Contributor: Jingyu Zhang, 2022-08-23T22:34:43,253 running egg_info 2022-08-23T22:34:43,846 writing wrds2pg.egg-info/PKG-INFO 2022-08-23T22:34:44,439 writing dependency_links to wrds2pg.egg-info/dependency_links.txt 2022-08-23T22:34:47,396 writing requirements to wrds2pg.egg-info/requires.txt 2022-08-23T22:34:47,992 writing top-level names to wrds2pg.egg-info/top_level.txt 2022-08-23T22:34:48,707 reading manifest file 'wrds2pg.egg-info/SOURCES.txt' 2022-08-23T22:34:48,712 adding license file 'LICENCE' 2022-08-23T22:34:48,717 writing manifest file 'wrds2pg.egg-info/SOURCES.txt' 2022-08-23T22:34:48,936 Getting requirements to build wheel: finished with status 'done' 2022-08-23T22:34:48,956 Created temporary directory: /tmp/pip-modern-metadata-fxgazjir 2022-08-23T22:34:48,962 Preparing metadata (pyproject.toml): started 2022-08-23T22:34:48,964 Running command Preparing metadata (pyproject.toml) 2022-08-23T22:34:55,172 # WRDS (or SAS) to PostgreSQL 2022-08-23T22:34:55,173 This software has two functions: 2022-08-23T22:34:55,173 - Download tables from [WRDS](https://wrds-web.wharton.upenn.edu/wrds/) and feed them to a PostgreSQL database. (Requires access to WRDS and to the data in question.) 2022-08-23T22:34:55,174 - Import a SAS file (`*.sas7dbat`) into a PostgreSQL database. 2022-08-23T22:34:55,175 ## Requirements 2022-08-23T22:34:55,175 ### 1. Python 2022-08-23T22:34:55,176 The software uses Python 3 and depends on Pandas, SQLAlchemy and Paramiko. In addition, the Python scripts generally interact with PostgreSQL using SQLAlchemy and the [Psycopg](http://initd.org/psycopg/) library. 2022-08-23T22:34:55,176 These dependencies are installed when you use Pip (see instructions below). 2022-08-23T22:34:55,177 ### 2. A WRDS ID 2022-08-23T22:34:55,177 To use public-key authentication to access WRDS, follow hints taken from [here](https://debian-administration.org/article/152/Password-less_logins_with_OpenSSH) to set up a public key. 2022-08-23T22:34:55,177 Copy that key to the WRDS server from the terminal on your computer. 2022-08-23T22:34:55,178 (Note that this code assumes you have a directory `.ssh` in your home directory. If not, log into WRDS via SSH, then type `mkdir ~/.ssh` to create this.) 2022-08-23T22:34:55,178 Here's code (for me) to create the key and send it to WRDS: 2022-08-23T22:34:55,178 ``` 2022-08-23T22:34:55,179 ssh-keygen -t rsa 2022-08-23T22:34:55,179 cat ~/.ssh/id_rsa.pub | ssh iangow@wrds-cloud.wharton.upenn.edu "cat >> ~/.ssh/authorized_keys" 2022-08-23T22:34:55,179 ``` 2022-08-23T22:34:55,180 Use an empty passphrase in setting up the key so that the scripts can run without user intervention. 2022-08-23T22:34:55,180 ### 3. PostgreSQL 2022-08-23T22:34:55,181 You should have a PostgreSQL database to store the data. 2022-08-23T22:34:55,181 ### 4. Environment variables 2022-08-23T22:34:55,182 Environment variables that the code can use include: 2022-08-23T22:34:55,182 - `PGDATABASE`: The name of the PostgreSQL database you use. 2022-08-23T22:34:55,183 - `PGUSER`: Your username on the PostgreSQL database. 2022-08-23T22:34:55,183 - `PGHOST`: Where the PostgreSQL database is to be found (this will be `localhost` if its on the same machine as you're running the code on) 2022-08-23T22:34:55,184 - `WRDS_ID`: Your [WRDS](https://wrds-web.wharton.upenn.edu/wrds/) ID. 2022-08-23T22:34:55,184 I set these environment variables in `~/.profile`: 2022-08-23T22:34:55,185 ``` 2022-08-23T22:34:55,185 export PGHOST="localhost" 2022-08-23T22:34:55,186 export PGDATABASE="crsp" 2022-08-23T22:34:55,186 export WRDS_ID="iangow" 2022-08-23T22:34:55,186 export PGUSER="igow" 2022-08-23T22:34:55,186 ``` 2022-08-23T22:34:55,187 ## Using the function `wrds_update`. 2022-08-23T22:34:55,188 Two arguments `table_name` and `schema` are required. 2022-08-23T22:34:55,188 ### 1. WRDS Settings 2022-08-23T22:34:55,189 Set `WRDS_ID` using either `wrds_id=your_wrds_id` in the function call or the environment variable `WRDS_ID`. 2022-08-23T22:34:55,189 ### 2. Environment variables 2022-08-23T22:34:55,190 The software will use the environment variables `PGHOST`, `PGDATABASE`, and `PGUSER` if you If you have set them. Otherwise, you need to provide values as arguments to `wrds_udpate()`. Default `PGPORT` is`5432`. 2022-08-23T22:34:55,190 ### 3. Table settings 2022-08-23T22:34:55,190 To tailor your request, specify the following arguments: 2022-08-23T22:34:55,191 - `fix_missing`: set to `True` to fix missing values. This addresses special missign values, which SAS's `PROC EXPORT` dumps as strings. Default value is `False`. 2022-08-23T22:34:55,191 - `fix_cr`: set to `True` to fix characters. Default value is `False`. 2022-08-23T22:34:55,192 - `drop`: add column names to be dropped (e.g., `drop="id name"` will drop columns `id` and `name`). 2022-08-23T22:34:55,192 - `obs`: add maxium number of observations (e.g., `obs=10` will import the first 10 rows from the table on WRDS). 2022-08-23T22:34:55,192 - `rename`: rename columns (e.g., `rename="fee=mngt_fee"` renames `fee` to `mngt_fee`). 2022-08-23T22:34:55,193 - `force`: set to `True` to force update. Default value is `False`. 2022-08-23T22:34:55,193 ## Importing SAS data into PostgreSQL 2022-08-23T22:34:55,194 The software can also upload SAS file directly to PostgreSQL. 2022-08-23T22:34:55,194 You need to have local SAS in order to use this function. 2022-08-23T22:34:55,194 Use `fpath` to specify the path to the file to be imported 2022-08-23T22:34:55,195 ### Examples 2022-08-23T22:34:55,195 Here are some examples. 2022-08-23T22:34:55,196 If you are at the home directory of this git repo, you can import and use the software as shown below. 2022-08-23T22:34:55,196 To install it from Github: 2022-08-23T22:34:55,197 ``` 2022-08-23T22:34:55,197 sudo -H pip3 install git+https://github.com/iangow/wrds2pg --upgrade 2022-08-23T22:34:55,198 ``` 2022-08-23T22:34:55,198 This software is also available from PyPI. To install it from [PyPI](https://pypi.org/project/wrds2pg/): 2022-08-23T22:34:55,199 ``` 2022-08-23T22:34:55,199 pip3 install wrds2pg 2022-08-23T22:34:55,199 ``` 2022-08-23T22:34:55,200 Example usage: 2022-08-23T22:34:55,200 ```py 2022-08-23T22:34:55,200 from wrds2pg import wrds_update 2022-08-23T22:34:55,201 # 1. Download crsp.mcti from wrds and upload to pg as crps.mcti 2022-08-23T22:34:55,201 # Simplest version 2022-08-23T22:34:55,202 wrds_update(table_name="mcti", schema="crsp") 2022-08-23T22:34:55,202 # Tailored arguments 2022-08-23T22:34:55,203 wrds_update(table_name="mcti", schema="crsp", host=your_pghost, 2022-08-23T22:34:55,203 dbname=your_pg_database, 2022-08-23T22:34:55,203 fix_missing=True, fix_cr=True, drop="b30ret b30ind", obs=10, 2022-08-23T22:34:55,203 rename="caldt=calendar_date", force=True) 2022-08-23T22:34:55,204 # 2. Upload test.sas7dbat to pg as crsp.mcti 2022-08-23T22:34:55,204 wrds_update(table_name="mcti", schema="crsp", fpath="your_path/test.sas7dbat") 2022-08-23T22:34:55,205 ``` 2022-08-23T22:34:55,205 ### Report bugs 2022-08-23T22:34:55,206 Author: Ian Gow, 2022-08-23T22:34:55,206 Contributor: Jingyu Zhang, 2022-08-23T22:34:55,207 running dist_info 2022-08-23T22:34:55,829 creating /tmp/pip-modern-metadata-fxgazjir/wrds2pg.egg-info 2022-08-23T22:34:56,455 writing /tmp/pip-modern-metadata-fxgazjir/wrds2pg.egg-info/PKG-INFO 2022-08-23T22:34:57,050 writing dependency_links to /tmp/pip-modern-metadata-fxgazjir/wrds2pg.egg-info/dependency_links.txt 2022-08-23T22:35:00,006 writing requirements to /tmp/pip-modern-metadata-fxgazjir/wrds2pg.egg-info/requires.txt 2022-08-23T22:35:00,602 writing top-level names to /tmp/pip-modern-metadata-fxgazjir/wrds2pg.egg-info/top_level.txt 2022-08-23T22:35:00,605 writing manifest file '/tmp/pip-modern-metadata-fxgazjir/wrds2pg.egg-info/SOURCES.txt' 2022-08-23T22:35:01,313 reading manifest file '/tmp/pip-modern-metadata-fxgazjir/wrds2pg.egg-info/SOURCES.txt' 2022-08-23T22:35:01,316 adding license file 'LICENCE' 2022-08-23T22:35:01,321 writing manifest file '/tmp/pip-modern-metadata-fxgazjir/wrds2pg.egg-info/SOURCES.txt' 2022-08-23T22:35:01,323 creating '/tmp/pip-modern-metadata-fxgazjir/wrds2pg-1.0.14.dist-info' 2022-08-23T22:35:01,535 adding license file "LICENCE" (matched pattern "LICEN[CS]E*") 2022-08-23T22:35:01,771 Preparing metadata (pyproject.toml): finished with status 'done' 2022-08-23T22:35:01,785 Source in /tmp/pip-wheel-h_tuer4t/wrds2pg_9b3270f3acd54cbe85f16bef98d68492 has version 1.0.14, which satisfies requirement wrds2pg==1.0.14 from https://files.pythonhosted.org/packages/30/5c/79161fc26f5a5c96b45c5d9f96c49164b7e32ff106d04ba0e6bf2e321b05/wrds2pg-1.0.14.tar.gz#sha256=1cc2bf21404aeb497da0fcd7d4463f95000888a138f0b1169c5898ea1468ec49 2022-08-23T22:35:01,788 Removed wrds2pg==1.0.14 from https://files.pythonhosted.org/packages/30/5c/79161fc26f5a5c96b45c5d9f96c49164b7e32ff106d04ba0e6bf2e321b05/wrds2pg-1.0.14.tar.gz#sha256=1cc2bf21404aeb497da0fcd7d4463f95000888a138f0b1169c5898ea1468ec49 from build tracker '/tmp/pip-build-tracker-asb2i8a0' 2022-08-23T22:35:01,801 Created temporary directory: /tmp/pip-unpack-c2r14o2c 2022-08-23T22:35:01,802 Building wheels for collected packages: wrds2pg 2022-08-23T22:35:01,812 Created temporary directory: /tmp/pip-wheel-d6vx0ve0 2022-08-23T22:35:01,813 Destination directory: /tmp/pip-wheel-d6vx0ve0 2022-08-23T22:35:01,819 Building wheel for wrds2pg (pyproject.toml): started 2022-08-23T22:35:01,821 Running command Building wheel for wrds2pg (pyproject.toml) 2022-08-23T22:35:07,588 # WRDS (or SAS) to PostgreSQL 2022-08-23T22:35:07,590 This software has two functions: 2022-08-23T22:35:07,590 - Download tables from [WRDS](https://wrds-web.wharton.upenn.edu/wrds/) and feed them to a PostgreSQL database. (Requires access to WRDS and to the data in question.) 2022-08-23T22:35:07,590 - Import a SAS file (`*.sas7dbat`) into a PostgreSQL database. 2022-08-23T22:35:07,591 ## Requirements 2022-08-23T22:35:07,592 ### 1. Python 2022-08-23T22:35:07,592 The software uses Python 3 and depends on Pandas, SQLAlchemy and Paramiko. In addition, the Python scripts generally interact with PostgreSQL using SQLAlchemy and the [Psycopg](http://initd.org/psycopg/) library. 2022-08-23T22:35:07,593 These dependencies are installed when you use Pip (see instructions below). 2022-08-23T22:35:07,593 ### 2. A WRDS ID 2022-08-23T22:35:07,593 To use public-key authentication to access WRDS, follow hints taken from [here](https://debian-administration.org/article/152/Password-less_logins_with_OpenSSH) to set up a public key. 2022-08-23T22:35:07,594 Copy that key to the WRDS server from the terminal on your computer. 2022-08-23T22:35:07,594 (Note that this code assumes you have a directory `.ssh` in your home directory. If not, log into WRDS via SSH, then type `mkdir ~/.ssh` to create this.) 2022-08-23T22:35:07,595 Here's code (for me) to create the key and send it to WRDS: 2022-08-23T22:35:07,595 ``` 2022-08-23T22:35:07,595 ssh-keygen -t rsa 2022-08-23T22:35:07,596 cat ~/.ssh/id_rsa.pub | ssh iangow@wrds-cloud.wharton.upenn.edu "cat >> ~/.ssh/authorized_keys" 2022-08-23T22:35:07,596 ``` 2022-08-23T22:35:07,596 Use an empty passphrase in setting up the key so that the scripts can run without user intervention. 2022-08-23T22:35:07,597 ### 3. PostgreSQL 2022-08-23T22:35:07,597 You should have a PostgreSQL database to store the data. 2022-08-23T22:35:07,598 ### 4. Environment variables 2022-08-23T22:35:07,599 Environment variables that the code can use include: 2022-08-23T22:35:07,599 - `PGDATABASE`: The name of the PostgreSQL database you use. 2022-08-23T22:35:07,600 - `PGUSER`: Your username on the PostgreSQL database. 2022-08-23T22:35:07,600 - `PGHOST`: Where the PostgreSQL database is to be found (this will be `localhost` if its on the same machine as you're running the code on) 2022-08-23T22:35:07,600 - `WRDS_ID`: Your [WRDS](https://wrds-web.wharton.upenn.edu/wrds/) ID. 2022-08-23T22:35:07,601 I set these environment variables in `~/.profile`: 2022-08-23T22:35:07,602 ``` 2022-08-23T22:35:07,602 export PGHOST="localhost" 2022-08-23T22:35:07,602 export PGDATABASE="crsp" 2022-08-23T22:35:07,603 export WRDS_ID="iangow" 2022-08-23T22:35:07,603 export PGUSER="igow" 2022-08-23T22:35:07,603 ``` 2022-08-23T22:35:07,604 ## Using the function `wrds_update`. 2022-08-23T22:35:07,605 Two arguments `table_name` and `schema` are required. 2022-08-23T22:35:07,605 ### 1. WRDS Settings 2022-08-23T22:35:07,606 Set `WRDS_ID` using either `wrds_id=your_wrds_id` in the function call or the environment variable `WRDS_ID`. 2022-08-23T22:35:07,606 ### 2. Environment variables 2022-08-23T22:35:07,607 The software will use the environment variables `PGHOST`, `PGDATABASE`, and `PGUSER` if you If you have set them. Otherwise, you need to provide values as arguments to `wrds_udpate()`. Default `PGPORT` is`5432`. 2022-08-23T22:35:07,607 ### 3. Table settings 2022-08-23T22:35:07,608 To tailor your request, specify the following arguments: 2022-08-23T22:35:07,608 - `fix_missing`: set to `True` to fix missing values. This addresses special missign values, which SAS's `PROC EXPORT` dumps as strings. Default value is `False`. 2022-08-23T22:35:07,609 - `fix_cr`: set to `True` to fix characters. Default value is `False`. 2022-08-23T22:35:07,609 - `drop`: add column names to be dropped (e.g., `drop="id name"` will drop columns `id` and `name`). 2022-08-23T22:35:07,610 - `obs`: add maxium number of observations (e.g., `obs=10` will import the first 10 rows from the table on WRDS). 2022-08-23T22:35:07,610 - `rename`: rename columns (e.g., `rename="fee=mngt_fee"` renames `fee` to `mngt_fee`). 2022-08-23T22:35:07,610 - `force`: set to `True` to force update. Default value is `False`. 2022-08-23T22:35:07,611 ## Importing SAS data into PostgreSQL 2022-08-23T22:35:07,611 The software can also upload SAS file directly to PostgreSQL. 2022-08-23T22:35:07,611 You need to have local SAS in order to use this function. 2022-08-23T22:35:07,612 Use `fpath` to specify the path to the file to be imported 2022-08-23T22:35:07,612 ### Examples 2022-08-23T22:35:07,613 Here are some examples. 2022-08-23T22:35:07,613 If you are at the home directory of this git repo, you can import and use the software as shown below. 2022-08-23T22:35:07,614 To install it from Github: 2022-08-23T22:35:07,615 ``` 2022-08-23T22:35:07,615 sudo -H pip3 install git+https://github.com/iangow/wrds2pg --upgrade 2022-08-23T22:35:07,615 ``` 2022-08-23T22:35:07,616 This software is also available from PyPI. To install it from [PyPI](https://pypi.org/project/wrds2pg/): 2022-08-23T22:35:07,616 ``` 2022-08-23T22:35:07,616 pip3 install wrds2pg 2022-08-23T22:35:07,617 ``` 2022-08-23T22:35:07,617 Example usage: 2022-08-23T22:35:07,617 ```py 2022-08-23T22:35:07,618 from wrds2pg import wrds_update 2022-08-23T22:35:07,618 # 1. Download crsp.mcti from wrds and upload to pg as crps.mcti 2022-08-23T22:35:07,619 # Simplest version 2022-08-23T22:35:07,619 wrds_update(table_name="mcti", schema="crsp") 2022-08-23T22:35:07,619 # Tailored arguments 2022-08-23T22:35:07,620 wrds_update(table_name="mcti", schema="crsp", host=your_pghost, 2022-08-23T22:35:07,620 dbname=your_pg_database, 2022-08-23T22:35:07,620 fix_missing=True, fix_cr=True, drop="b30ret b30ind", obs=10, 2022-08-23T22:35:07,621 rename="caldt=calendar_date", force=True) 2022-08-23T22:35:07,621 # 2. Upload test.sas7dbat to pg as crsp.mcti 2022-08-23T22:35:07,622 wrds_update(table_name="mcti", schema="crsp", fpath="your_path/test.sas7dbat") 2022-08-23T22:35:07,622 ``` 2022-08-23T22:35:07,622 ### Report bugs 2022-08-23T22:35:07,623 Author: Ian Gow, 2022-08-23T22:35:07,623 Contributor: Jingyu Zhang, 2022-08-23T22:35:07,624 running bdist_wheel 2022-08-23T22:35:08,830 running build 2022-08-23T22:35:08,830 running build_py 2022-08-23T22:35:09,463 creating build 2022-08-23T22:35:09,463 creating build/lib 2022-08-23T22:35:09,465 creating build/lib/wrds2pg 2022-08-23T22:35:09,467 copying wrds2pg/__init__.py -> build/lib/wrds2pg 2022-08-23T22:35:09,471 copying wrds2pg/wrds2pg.py -> build/lib/wrds2pg 2022-08-23T22:35:10,735 installing to build/bdist.linux-armv7l/wheel 2022-08-23T22:35:10,735 running install 2022-08-23T22:35:10,798 running install_lib 2022-08-23T22:35:11,477 creating build/bdist.linux-armv7l 2022-08-23T22:35:11,478 creating build/bdist.linux-armv7l/wheel 2022-08-23T22:35:11,481 creating build/bdist.linux-armv7l/wheel/wrds2pg 2022-08-23T22:35:11,483 copying build/lib/wrds2pg/__init__.py -> build/bdist.linux-armv7l/wheel/wrds2pg 2022-08-23T22:35:11,487 copying build/lib/wrds2pg/wrds2pg.py -> build/bdist.linux-armv7l/wheel/wrds2pg 2022-08-23T22:35:11,491 running install_egg_info 2022-08-23T22:35:12,799 running egg_info 2022-08-23T22:35:13,429 writing wrds2pg.egg-info/PKG-INFO 2022-08-23T22:35:14,027 writing dependency_links to wrds2pg.egg-info/dependency_links.txt 2022-08-23T22:35:17,000 writing requirements to wrds2pg.egg-info/requires.txt 2022-08-23T22:35:17,598 writing top-level names to wrds2pg.egg-info/top_level.txt 2022-08-23T22:35:17,640 reading manifest file 'wrds2pg.egg-info/SOURCES.txt' 2022-08-23T22:35:17,643 adding license file 'LICENCE' 2022-08-23T22:35:17,648 writing manifest file 'wrds2pg.egg-info/SOURCES.txt' 2022-08-23T22:35:17,650 Copying wrds2pg.egg-info to build/bdist.linux-armv7l/wheel/wrds2pg-1.0.14-py3.7.egg-info 2022-08-23T22:35:17,672 running install_scripts 2022-08-23T22:35:17,825 adding license file "LICENCE" (matched pattern "LICEN[CS]E*") 2022-08-23T22:35:17,833 creating build/bdist.linux-armv7l/wheel/wrds2pg-1.0.14.dist-info/WHEEL 2022-08-23T22:35:17,837 creating '/tmp/pip-wheel-d6vx0ve0/tmpsrikfxws/wrds2pg-1.0.14-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2022-08-23T22:35:17,841 adding 'wrds2pg/__init__.py' 2022-08-23T22:35:17,847 adding 'wrds2pg/wrds2pg.py' 2022-08-23T22:35:17,852 adding 'wrds2pg-1.0.14.dist-info/LICENCE' 2022-08-23T22:35:17,855 adding 'wrds2pg-1.0.14.dist-info/METADATA' 2022-08-23T22:35:17,856 adding 'wrds2pg-1.0.14.dist-info/WHEEL' 2022-08-23T22:35:17,858 adding 'wrds2pg-1.0.14.dist-info/top_level.txt' 2022-08-23T22:35:17,860 adding 'wrds2pg-1.0.14.dist-info/RECORD' 2022-08-23T22:35:17,862 removing build/bdist.linux-armv7l/wheel 2022-08-23T22:35:18,129 Building wheel for wrds2pg (pyproject.toml): finished with status 'done' 2022-08-23T22:35:18,141 Created wheel for wrds2pg: filename=wrds2pg-1.0.14-py3-none-any.whl size=9629 sha256=53fe3952f56473e22acc56e2dfd684dcf50d6e10ae4df2b9564d783a0323f3cc 2022-08-23T22:35:18,143 Stored in directory: /tmp/pip-ephem-wheel-cache-vf0eqg6q/wheels/81/0a/e6/2591dac8bbed8b657866fae5ac36238c14b1ddc969915208c1 2022-08-23T22:35:18,165 Successfully built wrds2pg 2022-08-23T22:35:18,173 Removed build tracker: '/tmp/pip-build-tracker-asb2i8a0'