2023-12-04T20:01:53,045 Created temporary directory: /tmp/pip-build-tracker-qv5f50bh 2023-12-04T20:01:53,047 Initialized build tracking at /tmp/pip-build-tracker-qv5f50bh 2023-12-04T20:01:53,047 Created build tracker: /tmp/pip-build-tracker-qv5f50bh 2023-12-04T20:01:53,048 Entered build tracker: /tmp/pip-build-tracker-qv5f50bh 2023-12-04T20:01:53,048 Created temporary directory: /tmp/pip-wheel-6b60r1ui 2023-12-04T20:01:53,051 Created temporary directory: /tmp/pip-ephem-wheel-cache-qex78mtq 2023-12-04T20:01:53,073 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-12-04T20:01:53,077 2 location(s) to search for versions of wrds2pg: 2023-12-04T20:01:53,077 * https://pypi.org/simple/wrds2pg/ 2023-12-04T20:01:53,077 * https://www.piwheels.org/simple/wrds2pg/ 2023-12-04T20:01:53,077 Fetching project page and analyzing links: https://pypi.org/simple/wrds2pg/ 2023-12-04T20:01:53,078 Getting page https://pypi.org/simple/wrds2pg/ 2023-12-04T20:01:53,080 Found index url https://pypi.org/simple/ 2023-12-04T20:01:53,291 Fetched page https://pypi.org/simple/wrds2pg/ as application/vnd.pypi.simple.v1+json 2023-12-04T20:01:53,303 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/36/4d/10bef13832bdc17990beac4a20b47a77976768547aa4bd6137cbafd46f83/wrds2pg-0.1.17-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,304 Found link https://files.pythonhosted.org/packages/ae/9c/ee0b12002821c2c8e21625c915081fc315d9f1ceef100cb330e9116f2d0d/wrds2pg-0.1.17.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.17 2023-12-04T20:01:53,304 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/ac/24/35ec84d1b765955286a326d0f0c98423730b5818f33c5cdc3e2a2d528adf/wrds2pg-0.1.18-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,305 Found link https://files.pythonhosted.org/packages/dd/4f/6c631513b90802ad1fae0c3fb3dbf65efc603d3fee00a1cae4af45f6b2c5/wrds2pg-0.1.18.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.18 2023-12-04T20:01:53,306 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/42/1a/cbdac7035e9b7836ed96c6a9e493b556d3f595245c4f0b239c9ba639d53e/wrds2pg-0.1.20-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,307 Found link https://files.pythonhosted.org/packages/14/81/4c94b875ec21dccdefb6a1846bc4f4d4a6a529a0a6921cbbf580e07f8b6b/wrds2pg-0.1.20.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.20 2023-12-04T20:01:53,308 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/e7/a1/192e3bf4b1e122d0b12a094f4ee4fd1667276cb87cbe5d0a53412dc1a9bc/wrds2pg-0.1.21-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,309 Found link https://files.pythonhosted.org/packages/4d/4c/5fa9cc2e936e16d0be4a56ce2e8cf03b3ba0f59f49afdebd29f1eda99df4/wrds2pg-0.1.21.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.21 2023-12-04T20:01:53,310 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/4a/52/d9134119b39cf9e939e7cc5ab1317627406af4229fcbdf1085df366e01b4/wrds2pg-0.1.22-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,311 Found link https://files.pythonhosted.org/packages/5b/db/ebbf903d32ac113cdd0b3637f1e5dc37a4abf9f63f18dd56835f3611a465/wrds2pg-0.1.22.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.22 2023-12-04T20:01:53,312 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/c9/47/a040be2f7d67c120396a27beb1f5e3a6eb97fd24e17cd485ec6d332dad6e/wrds2pg-0.1.23-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,313 Found link https://files.pythonhosted.org/packages/4e/aa/b4f4227ff1d464462f243592bddd638d07e886aa39018ef2bb486624e2f5/wrds2pg-0.1.23.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.23 2023-12-04T20:01:53,313 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/7b/bf/a713b52aff61a20e5e9d851a69d7c4936d14018ed62759dd78629bfe12cf/wrds2pg-0.1.24-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,315 Found link https://files.pythonhosted.org/packages/ca/e9/81095cbac75110e7f53e915ebee06a9925bb32b6d8a307c7a709f9b74dd5/wrds2pg-0.1.24.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 0.1.24 2023-12-04T20:01:53,315 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/01/5d/cfd9a9cfe8194d52e16c24ef053b49225e85f0996c471226fc0cf5522e31/wrds2pg-1.0.0-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,316 Found link https://files.pythonhosted.org/packages/af/8f/069eed28514231a859da3b110112a0b2078f2c879e3cc5489909982ef2af/wrds2pg-1.0.0.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.0 2023-12-04T20:01:53,317 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/90/3d/1fc327c68c63a7540a964879a5a124e9104c5a80cd058a5f0659d2945dd5/wrds2pg-1.0.2-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,318 Found link https://files.pythonhosted.org/packages/fa/b0/49292467a2256c3ecdd7e7fdbd1c4729386bddc06f3a986483a311539f2b/wrds2pg-1.0.2.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.2 2023-12-04T20:01:53,319 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/41/99/2866d67e2fcd10684ccc913eaa896ebcc00c60982133a5adfaa8a39b7aa1/wrds2pg-1.0.3-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,320 Found link https://files.pythonhosted.org/packages/0f/bf/b1032fff1645c597e292ac8d588c33bad73ca567c01e52fb149f4aa503d1/wrds2pg-1.0.3.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.3 2023-12-04T20:01:53,320 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/0b/6c/bc13811b3a339ec1455a10a03b077d0a7fc7e43b3311201abbfc67d77fde/wrds2pg-1.0.4-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,321 Found link https://files.pythonhosted.org/packages/dc/f4/166d8822216116c22615377ab6493a7c44bd205b8853ae2b0ad51792d9e6/wrds2pg-1.0.4.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.4 2023-12-04T20:01:53,322 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/78/a7/afce414cb2df44692f2dd5af0e28578c349e337110fb7c73b893cef3c048/wrds2pg-1.0.5-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,323 Found link https://files.pythonhosted.org/packages/64/a7/18d7edab1e04462bf1aafd2fe6ffc9132f0aa11be6daaf14927c532b73d3/wrds2pg-1.0.5.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.5 2023-12-04T20:01:53,324 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/2b/8f/02f345286a6b878468948ab7bc6a56026077f0cbfb25d11440284519ba7a/wrds2pg-1.0.6-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,325 Found link https://files.pythonhosted.org/packages/8c/06/abb4c39f3e3f730fffe349e03e1172e31c95fbb9edf4c9257bfb0b6e2c62/wrds2pg-1.0.6.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.6 2023-12-04T20:01:53,326 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/3f/b5/99b90fee6aaf0b150803cfbd6d86e0052d292257dd101e803df4d945ad7b/wrds2pg-1.0.8-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,327 Found link https://files.pythonhosted.org/packages/eb/9f/a506b309ee9299d4d9cd3f5c1407e05da30c09cbbe8acf67e60de11a1b4e/wrds2pg-1.0.8.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.8 2023-12-04T20:01:53,328 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/80/6d/34291718af062c4c329fbaeaaa582e011da15ce1193364f668581c3bd983/wrds2pg-1.0.9-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,329 Found link https://files.pythonhosted.org/packages/27/20/2b9788aef9e54ea3d590a456caa294d1c177fd05029e8f70b99022369f68/wrds2pg-1.0.9.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.9 2023-12-04T20:01:53,329 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/99/ac/4d765cf6d5048798219506138f491e7218d56226bd1d4a1ab994e5efcf33/wrds2pg-1.0.10-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,330 Found link https://files.pythonhosted.org/packages/f4/6a/630cd948c36f331db42c9bac9e414e721e779efbb692210419563d9f4ec1/wrds2pg-1.0.10.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.10 2023-12-04T20:01:53,331 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/4b/8f/7a43a074a7f9fb3b14acbe6a7fdfe50e99d8489334adcc941ed6b4ca328b/wrds2pg-1.0.11-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,332 Found link https://files.pythonhosted.org/packages/e8/2b/f8c9e8ea4d651a9e15946e91b9f1708582a8631b6a76ddb16ad9275bb7a5/wrds2pg-1.0.11.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.11 2023-12-04T20:01:53,332 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/20/62/e4cff4d188653aa99e511ec9db794706d3e0eca3a072847c47b59fb281ba/wrds2pg-1.0.12-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,333 Found link https://files.pythonhosted.org/packages/14/9c/6db066ea90188c63fbacdfb53d2efd52e3ffb2f86ac229616b5ded27dabb/wrds2pg-1.0.12.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.12 2023-12-04T20:01:53,334 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/00/0d/9122175d258c706db78ca1df2f46092a8f7caf9b85bb55fbb05bf8149b43/wrds2pg-1.0.13-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,335 Found link https://files.pythonhosted.org/packages/21/32/ed7df674875559e6afaacdfe2a846a78e88355b187349fb0890a00a9c87b/wrds2pg-1.0.13.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.13 2023-12-04T20:01:53,336 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/98/27/a36bbe15df3fdbcf27a96e7a5b5f48c13d379465e4daf4889b5fd556eea0/wrds2pg-1.0.14-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,337 Found link https://files.pythonhosted.org/packages/30/5c/79161fc26f5a5c96b45c5d9f96c49164b7e32ff106d04ba0e6bf2e321b05/wrds2pg-1.0.14.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.14 2023-12-04T20:01:53,337 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/6f/56/b5f28563dbd278bc973e9b09d08b701083b92dc9facf367208f412bae2b1/wrds2pg-1.0.15-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,338 Found link https://files.pythonhosted.org/packages/7f/ae/a9479ffa558cb219a91c2233d27c8cb0a1151361563f417f9a49414f9a9a/wrds2pg-1.0.15.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.15 2023-12-04T20:01:53,339 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/bd/a2/1d66cc227f78fb727160e17d625347dd9ce5a4934e9dc670946b36cb4a92/wrds2pg-1.0.16-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,340 Found link https://files.pythonhosted.org/packages/ec/17/b23b515c3360befddb0e907abe4226ddfdd0573d7924902fc835f9619fce/wrds2pg-1.0.16.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.16 2023-12-04T20:01:53,341 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/49/e4/64ec56d95ae7ca0c1fe4b799b5754885b5b8c9d8142d6467a146b098ca35/wrds2pg-1.0.17-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,341 Found link https://files.pythonhosted.org/packages/75/70/98e83341d542d3326bce285d748f86da9228a911370d23255e177dbe3789/wrds2pg-1.0.17.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.17 2023-12-04T20:01:53,342 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/88/8d/834a67d927ed1035f5b44fdf0756a52bf6c7e5e6dd00bbc84a0c3fbc31bd/wrds2pg-1.0.18-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,343 Found link https://files.pythonhosted.org/packages/89/ee/528ff63a2445d7054239dd15a2dcf61a8e38dfdddf15ea922fb2d5f4fb3b/wrds2pg-1.0.18.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.18 2023-12-04T20:01:53,343 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/7e/02/034253d7a78408fc49066aa8b18b8c3551ed8048c86be057f59273d88b98/wrds2pg-1.0.19-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,344 Found link https://files.pythonhosted.org/packages/62/f5/b9ecfd4c1bd880f989962d37c49eec1d2772088a2185aa089ac972cb56ca/wrds2pg-1.0.19.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.19 2023-12-04T20:01:53,345 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/1e/c9/7e25410937513695c83098cdd4ae2444f75d17ec0136f8d3e7b11cbb4774/wrds2pg-1.0.20-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,345 Found link https://files.pythonhosted.org/packages/46/0b/8302005418956f8f63cb59c0af8484a1af4bfee961f142d653047184dc95/wrds2pg-1.0.20.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.20 2023-12-04T20:01:53,346 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/c0/c1/c85866829efe728ce4b7efe13acfe2853ba0e9a4b9db031870c11a5c05e7/wrds2pg-1.0.21-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,347 Found link https://files.pythonhosted.org/packages/7a/f6/ed1edc24bed4c3637625a06ede755f8b8cea5fcff8e5e571b83d577b6249/wrds2pg-1.0.21.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.21 2023-12-04T20:01:53,348 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/0e/e6/8a32b9a2d443a03ae9568a7bb49610fea1b01e834ee29fe7edaf2be7c928/wrds2pg-1.0.22-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,349 Found link https://files.pythonhosted.org/packages/b2/74/4fb8f203d6e29830f73b747d1fbc0137b1051b1f227e99adc8e7c1ff304e/wrds2pg-1.0.22.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.22 2023-12-04T20:01:53,349 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/0d/fe/17ec0fbf04f828dfb33ee28087c99f8a2cb3b88c106c8f4b1dccf170edd5/wrds2pg-1.0.23-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,350 Found link https://files.pythonhosted.org/packages/25/5d/38b9f9e952975898c2c79b1c76afbe5f7b2d78f9b28db3a65cda30e49bc5/wrds2pg-1.0.23.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.23 2023-12-04T20:01:53,351 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/3d/56/52a54ccca6cb47522854c34d05cb333588fa3fd01854575995ff5b249139/wrds2pg-1.0.24-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,352 Found link https://files.pythonhosted.org/packages/46/8f/65d741e63fa2bf4cb8de88769e55d9f07e45266ae95f5b3db7ae1cd77403/wrds2pg-1.0.24.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.24 2023-12-04T20:01:53,353 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/9f/02/d7768f1a97f8917022645706118e976fc63dc6bf9150434d2f49891b14e9/wrds2pg-1.0.25-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,354 Found link https://files.pythonhosted.org/packages/f2/e7/3e5775d0c26ea942095df0c1a880d4dd0c897ffa61e774824acf20e9d1d6/wrds2pg-1.0.25.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.25 2023-12-04T20:01:53,354 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/d2/6b/745d21e21f68fb715dc1ad1b046ea8031189fea06bb7d42d48ffa55e3a8a/wrds2pg-1.0.26-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,355 Found link https://files.pythonhosted.org/packages/3a/a5/5181ce6c86c2059025738941c88f37c22bfcd528f2932281c9d779f422b4/wrds2pg-1.0.26.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.26 2023-12-04T20:01:53,355 Skipping link: No binaries permitted for wrds2pg: https://files.pythonhosted.org/packages/d6/32/3bb968da3f4cbe924ee22fedc5ffb1b6111ecb910f68c9905a201770b15d/wrds2pg-1.0.27-py3-none-any.whl (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,356 Found link https://files.pythonhosted.org/packages/74/0a/7d02353b0ab90e16e9e25c24b22479b5e970eb71bd0112e3551b82b8a83d/wrds2pg-1.0.27.tar.gz (from https://pypi.org/simple/wrds2pg/) (requires-python:>=3), version: 1.0.27 2023-12-04T20:01:53,357 Fetching project page and analyzing links: https://www.piwheels.org/simple/wrds2pg/ 2023-12-04T20:01:53,358 Getting page https://www.piwheels.org/simple/wrds2pg/ 2023-12-04T20:01:53,359 Found index url https://www.piwheels.org/simple/ 2023-12-04T20:01:53,523 Fetched page https://www.piwheels.org/simple/wrds2pg/ as text/html 2023-12-04T20:01:53,532 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.26-py3-none-any.whl#sha256=bf4c9aee7ec6db12956e51469680fba7f955e161359dcf50983608d19fb50d2b (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,533 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.25-py3-none-any.whl#sha256=ef9a415cb88f8ca6c0fb4a27abdec4f3db793e804c37d98f75b66abab20cb88b (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,534 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.24-py3-none-any.whl#sha256=7384c63ede6fffe6aa9764b8f4688ec660d35d97879587a4f6ef223ccca565bc (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,534 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.23-py3-none-any.whl#sha256=c3d00616b05071c6d571976d1aac35b5bd12e89663a8e6c3cd8ce7d6bbb2be5b (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,535 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.22-py3-none-any.whl#sha256=f65676481292ee2d04c0a56929cbb35c1827cabd9bd3bd9fcb13c0ef4c3148a0 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,535 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.21-py3-none-any.whl#sha256=6c23f3276d89be161c84e241077eef4e7c11506e74646c5c118aa2002f6ab2f0 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,536 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.20-py3-none-any.whl#sha256=ed305eccfd7f2b37f24ac42a6ed548a20b2bbe7eaed050bb37ebb2f672dea1e0 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,536 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.19-py3-none-any.whl#sha256=6979a3bb64e7c881ec3403e97c60d351155ef3d5f083149e785180b8f9929daa (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,537 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.18-py3-none-any.whl#sha256=0970135447d68b94dc197fa962f947d92967207bac9a08776eb9b1690918d523 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,538 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.17-py3-none-any.whl#sha256=381f568a66ebb1a992cc9ca11b938ef34d98788ce84e7367b53b53fe2564326d (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,538 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.16-py3-none-any.whl#sha256=b42a003e724ff3690da66991638a7180c1b39d37529ed63df71168693a20f532 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,538 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.15-py3-none-any.whl#sha256=d8d869592634a4a6230d73cb1fd31a0b954cd53251250d096d8c28a269527d0c (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,539 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.14-py3-none-any.whl#sha256=53fe3952f56473e22acc56e2dfd684dcf50d6e10ae4df2b9564d783a0323f3cc (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,539 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.13-py3-none-any.whl#sha256=dbb6b8140842cdf6dd074f31a847e5a7d6901706af211e0aff676dfb0a2dc5d5 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,540 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.12-py3-none-any.whl#sha256=a49ec8094e122aa39eaf87b3eaf04951ba358b7de814db7232d3d23db0ee7321 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,540 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.11-py3-none-any.whl#sha256=10c887b1d51113a546d42a5ff5c773acceb67e44b4dbc7f2c8e185e146bdbe3b (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,541 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.10-py3-none-any.whl#sha256=d7a91f736c8b935d21aaef6d5b729044c3b27fa3fe740e21bf54aeece56e3f13 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,542 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.9-py3-none-any.whl#sha256=544627010f3f3125f38a8b442475cb841a1e7b63e9644d7ed1c98245e5e8ffeb (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,542 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.8-py3-none-any.whl#sha256=4bca52110d40065aada2ca48ed090ab85a34add55c09c804f9586fd454ae3205 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,543 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.6-py3-none-any.whl#sha256=ba63b46b31e7f735db37bebf8ad301e976085a10628fcb01be40dbc9325267f9 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,543 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.5-py3-none-any.whl#sha256=21abfd3fabf17eba315d7110979b9ed42f54051f205d859da68568b4699e291b (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,544 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.4-py3-none-any.whl#sha256=8197d920152df0686f6cd8ca31af2f46820802334c63a0991ca0ddd1c215c909 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,545 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.3-py3-none-any.whl#sha256=12de805441cbd63af3d66e6a2c651f8f7d15e77dc5c3714035cd450ea1708785 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,545 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.2-py3-none-any.whl#sha256=73be788eb7aee9fce430717615f683c7f912a817238a33697f41f26b85726147 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,546 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-1.0.0-py3-none-any.whl#sha256=89d17b1aae3ffc78c0c02e87a2f663b83648460da7a8406027d62ae7c9ceb164 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,546 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.24-py3-none-any.whl#sha256=8bfd551d615500576f778b977f5771b5011d87a962c1d43e8b7aae7c42f6bafb (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,546 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.23-py3-none-any.whl#sha256=24b5f15364dc798de6d21d3f2d117ce1d7c6e6e0768e8268e7b196943d36d1bd (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,547 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.22-py3-none-any.whl#sha256=bfa8fbfc09819fe5524153f82e6fc631069dab5096b0013b03aae5600346a2ab (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,547 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.21-py3-none-any.whl#sha256=f9ab26b51603e3bf82196a52410a990d95685ee6bedc4a88572340686d09affc (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,548 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.20-py3-none-any.whl#sha256=bdca9bdaa2e54c59f2120c519804dc52bf271a35e03a80dd8b1f65f961f28ff6 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,548 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.18-py3-none-any.whl#sha256=896ccb2badb2923b55bb6fbe62a8d74604733c8c9c0181b144e2e2f9aabb629c (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,549 Skipping link: No binaries permitted for wrds2pg: https://www.piwheels.org/simple/wrds2pg/wrds2pg-0.1.17-py3-none-any.whl#sha256=3471efec23d7b15c86751d79adc43cb425d7ad46016afc247f1e1992b78083b9 (from https://www.piwheels.org/simple/wrds2pg/) (requires-python:>=3) 2023-12-04T20:01:53,550 Skipping link: not a file: https://www.piwheels.org/simple/wrds2pg/ 2023-12-04T20:01:53,550 Skipping link: not a file: https://pypi.org/simple/wrds2pg/ 2023-12-04T20:01:53,572 Given no hashes to check 1 links for project 'wrds2pg': discarding no candidates 2023-12-04T20:01:53,590 Collecting wrds2pg==1.0.27 2023-12-04T20:01:53,593 Created temporary directory: /tmp/pip-unpack-1yltzzuh 2023-12-04T20:01:53,810 Downloading wrds2pg-1.0.27.tar.gz (12 kB) 2023-12-04T20:01:53,843 Added wrds2pg==1.0.27 from https://files.pythonhosted.org/packages/74/0a/7d02353b0ab90e16e9e25c24b22479b5e970eb71bd0112e3551b82b8a83d/wrds2pg-1.0.27.tar.gz to build tracker '/tmp/pip-build-tracker-qv5f50bh' 2023-12-04T20:01:53,847 Created temporary directory: /tmp/pip-build-env-078xqwu1 2023-12-04T20:01:53,852 Installing build dependencies: started 2023-12-04T20:01:53,853 Running command pip subprocess to install build dependencies 2023-12-04T20:01:55,207 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2023-12-04T20:01:56,302 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-12-04T20:01:57,747 Collecting setuptools>=42 2023-12-04T20:01:57,762 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.0.2-py3-none-any.whl (819 kB) 2023-12-04T20:01:57,979 Collecting wheel 2023-12-04T20:01:57,993 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2023-12-04T20:02:00,803 Installing collected packages: wheel, setuptools 2023-12-04T20:02:01,635 Creating /tmp/pip-build-env-078xqwu1/overlay/local/bin 2023-12-04T20:02:01,637 changing mode of /tmp/pip-build-env-078xqwu1/overlay/local/bin/wheel to 755 2023-12-04T20:02:13,567 Successfully installed setuptools-69.0.2 wheel-0.42.0 2023-12-04T20:02:14,331 Installing build dependencies: finished with status 'done' 2023-12-04T20:02:14,335 Getting requirements to build wheel: started 2023-12-04T20:02:14,336 Running command Getting requirements to build wheel 2023-12-04T20:02:14,907 # WRDS (or SAS) to PostgreSQL 2023-12-04T20:02:14,907 This software has two functions: 2023-12-04T20:02:14,908 - Download tables from [WRDS](https://wrds-web.wharton.upenn.edu/wrds/) and feed them to a PostgreSQL database. (Requires access to WRDS and to the data in question.) 2023-12-04T20:02:14,908 - Import a SAS file (`*.sas7dbat`) into a PostgreSQL database. 2023-12-04T20:02:14,909 ## Requirements 2023-12-04T20:02:14,910 ### 1. Python 2023-12-04T20:02:14,911 The software uses Python 3 and depends on Pandas, SQLAlchemy and Paramiko. In addition, the Python scripts generally interact with PostgreSQL using SQLAlchemy and the [Psycopg](http://initd.org/psycopg/) library. 2023-12-04T20:02:14,911 These dependencies are installed when you use Pip (see instructions below). 2023-12-04T20:02:14,912 ### 2. A WRDS ID 2023-12-04T20:02:14,913 To use public-key authentication to access WRDS, follow hints taken from [here](https://debian-administration.org/article/152/Password-less_logins_with_OpenSSH) to set up a public key. 2023-12-04T20:02:14,914 Copy that key to the WRDS server from the terminal on your computer. 2023-12-04T20:02:14,914 (Note that this code assumes you have a directory `.ssh` in your home directory. If not, log into WRDS via SSH, then type `mkdir ~/.ssh` to create this.) 2023-12-04T20:02:14,915 Here's code (for me) to create the key and send it to WRDS: 2023-12-04T20:02:14,915 ``` 2023-12-04T20:02:14,916 ssh-keygen -t rsa 2023-12-04T20:02:14,917 cat ~/.ssh/id_rsa.pub | ssh iangow@wrds-cloud.wharton.upenn.edu "cat >> ~/.ssh/authorized_keys" 2023-12-04T20:02:14,917 ``` 2023-12-04T20:02:14,918 Use an empty passphrase in setting up the key so that the scripts can run without user intervention. 2023-12-04T20:02:14,919 ### 3. PostgreSQL 2023-12-04T20:02:14,920 You should have a PostgreSQL database to store the data. 2023-12-04T20:02:14,921 ### 4. Environment variables 2023-12-04T20:02:14,923 Environment variables that the code can use include: 2023-12-04T20:02:14,924 - `PGDATABASE`: The name of the PostgreSQL database you use. 2023-12-04T20:02:14,924 - `PGUSER`: Your username on the PostgreSQL database. 2023-12-04T20:02:14,925 - `PGHOST`: Where the PostgreSQL database is to be found (this will be `localhost` if its on the same machine as you're running the code on) 2023-12-04T20:02:14,926 - `WRDS_ID`: Your [WRDS](https://wrds-web.wharton.upenn.edu/wrds/) ID. 2023-12-04T20:02:14,927 I set these environment variables in `~/.profile`: 2023-12-04T20:02:14,928 ``` 2023-12-04T20:02:14,929 export PGHOST="localhost" 2023-12-04T20:02:14,929 export PGDATABASE="crsp" 2023-12-04T20:02:14,930 export WRDS_ID="iangow" 2023-12-04T20:02:14,931 export PGUSER="igow" 2023-12-04T20:02:14,931 ``` 2023-12-04T20:02:14,932 ## Using the function `wrds_update`. 2023-12-04T20:02:14,933 Two arguments `table_name` and `schema` are required. 2023-12-04T20:02:14,934 ### 1. WRDS Settings 2023-12-04T20:02:14,935 Set `WRDS_ID` using either `wrds_id=your_wrds_id` in the function call or the environment variable `WRDS_ID`. 2023-12-04T20:02:14,936 ### 2. Environment variables 2023-12-04T20:02:14,936 The software will use the environment variables `PGHOST`, `PGDATABASE`, and `PGUSER` if you If you have set them. Otherwise, you need to provide values as arguments to `wrds_udpate()`. Default `PGPORT` is`5432`. 2023-12-04T20:02:14,937 ### 3. Table settings 2023-12-04T20:02:14,938 To tailor your request, specify the following arguments: 2023-12-04T20:02:14,939 - `fix_missing`: set to `True` to fix missing values. This addresses special missign values, which SAS's `PROC EXPORT` dumps as strings. Default value is `False`. 2023-12-04T20:02:14,939 - `fix_cr`: set to `True` to fix characters. Default value is `False`. 2023-12-04T20:02:14,940 - `drop`: add column names to be dropped (e.g., `drop="id name"` will drop columns `id` and `name`). 2023-12-04T20:02:14,940 - `obs`: add maxium number of observations (e.g., `obs=10` will import the first 10 rows from the table on WRDS). 2023-12-04T20:02:14,941 - `rename`: rename columns (e.g., `rename="fee=mngt_fee"` renames `fee` to `mngt_fee`). 2023-12-04T20:02:14,941 - `force`: set to `True` to force update. Default value is `False`. 2023-12-04T20:02:14,942 ## Importing SAS data into PostgreSQL 2023-12-04T20:02:14,943 The software can also upload SAS file directly to PostgreSQL. 2023-12-04T20:02:14,943 You need to have local SAS in order to use this function. 2023-12-04T20:02:14,944 Use `fpath` to specify the path to the file to be imported 2023-12-04T20:02:14,945 ### Examples 2023-12-04T20:02:14,945 Here are some examples. 2023-12-04T20:02:14,946 If you are at the home directory of this git repo, you can import and use the software as shown below. 2023-12-04T20:02:14,947 To install it from Github: 2023-12-04T20:02:14,949 ``` 2023-12-04T20:02:14,949 sudo -H pip3 install git+https://github.com/iangow/wrds2pg --upgrade 2023-12-04T20:02:14,950 ``` 2023-12-04T20:02:14,951 This software is also available from PyPI. To install it from [PyPI](https://pypi.org/project/wrds2pg/): 2023-12-04T20:02:14,952 ``` 2023-12-04T20:02:14,952 pip3 install wrds2pg 2023-12-04T20:02:14,953 ``` 2023-12-04T20:02:14,954 Example usage: 2023-12-04T20:02:14,954 ```py 2023-12-04T20:02:14,955 from wrds2pg import wrds_update 2023-12-04T20:02:14,956 # 1. Download crsp.mcti from wrds and upload to pg as crps.mcti 2023-12-04T20:02:14,956 # Simplest version 2023-12-04T20:02:14,957 wrds_update(table_name="mcti", schema="crsp") 2023-12-04T20:02:14,958 # Tailored arguments 2023-12-04T20:02:14,959 wrds_update(table_name="mcti", schema="crsp", host=your_pghost, 2023-12-04T20:02:14,960 dbname=your_pg_database, 2023-12-04T20:02:14,960 fix_missing=True, fix_cr=True, drop="b30ret b30ind", obs=10, 2023-12-04T20:02:14,961 rename="caldt=calendar_date", force=True) 2023-12-04T20:02:14,963 # 2. Upload test.sas7dbat to pg as crsp.mcti 2023-12-04T20:02:14,963 wrds_update(table_name="mcti", schema="crsp", fpath="your_path/test.sas7dbat") 2023-12-04T20:02:14,964 ``` 2023-12-04T20:02:14,966 ### Report bugs 2023-12-04T20:02:14,966 Author: Ian Gow, 2023-12-04T20:02:14,967 Contributor: Jingyu Zhang, 2023-12-04T20:02:14,969 running egg_info 2023-12-04T20:02:14,970 writing wrds2pg.egg-info/PKG-INFO 2023-12-04T20:02:14,970 writing dependency_links to wrds2pg.egg-info/dependency_links.txt 2023-12-04T20:02:14,971 writing requirements to wrds2pg.egg-info/requires.txt 2023-12-04T20:02:14,972 writing top-level names to wrds2pg.egg-info/top_level.txt 2023-12-04T20:02:14,973 reading manifest file 'wrds2pg.egg-info/SOURCES.txt' 2023-12-04T20:02:14,973 adding license file 'LICENCE' 2023-12-04T20:02:14,974 writing manifest file 'wrds2pg.egg-info/SOURCES.txt' 2023-12-04T20:02:15,037 Getting requirements to build wheel: finished with status 'done' 2023-12-04T20:02:15,047 Created temporary directory: /tmp/pip-modern-metadata-5i6c9uhq 2023-12-04T20:02:15,049 Preparing metadata (pyproject.toml): started 2023-12-04T20:02:15,050 Running command Preparing metadata (pyproject.toml) 2023-12-04T20:02:15,528 # WRDS (or SAS) to PostgreSQL 2023-12-04T20:02:15,528 This software has two functions: 2023-12-04T20:02:15,529 - Download tables from [WRDS](https://wrds-web.wharton.upenn.edu/wrds/) and feed them to a PostgreSQL database. (Requires access to WRDS and to the data in question.) 2023-12-04T20:02:15,529 - Import a SAS file (`*.sas7dbat`) into a PostgreSQL database. 2023-12-04T20:02:15,530 ## Requirements 2023-12-04T20:02:15,531 ### 1. Python 2023-12-04T20:02:15,532 The software uses Python 3 and depends on Pandas, SQLAlchemy and Paramiko. In addition, the Python scripts generally interact with PostgreSQL using SQLAlchemy and the [Psycopg](http://initd.org/psycopg/) library. 2023-12-04T20:02:15,532 These dependencies are installed when you use Pip (see instructions below). 2023-12-04T20:02:15,533 ### 2. A WRDS ID 2023-12-04T20:02:15,534 To use public-key authentication to access WRDS, follow hints taken from [here](https://debian-administration.org/article/152/Password-less_logins_with_OpenSSH) to set up a public key. 2023-12-04T20:02:15,534 Copy that key to the WRDS server from the terminal on your computer. 2023-12-04T20:02:15,535 (Note that this code assumes you have a directory `.ssh` in your home directory. If not, log into WRDS via SSH, then type `mkdir ~/.ssh` to create this.) 2023-12-04T20:02:15,536 Here's code (for me) to create the key and send it to WRDS: 2023-12-04T20:02:15,536 ``` 2023-12-04T20:02:15,537 ssh-keygen -t rsa 2023-12-04T20:02:15,538 cat ~/.ssh/id_rsa.pub | ssh iangow@wrds-cloud.wharton.upenn.edu "cat >> ~/.ssh/authorized_keys" 2023-12-04T20:02:15,538 ``` 2023-12-04T20:02:15,539 Use an empty passphrase in setting up the key so that the scripts can run without user intervention. 2023-12-04T20:02:15,540 ### 3. PostgreSQL 2023-12-04T20:02:15,541 You should have a PostgreSQL database to store the data. 2023-12-04T20:02:15,542 ### 4. Environment variables 2023-12-04T20:02:15,543 Environment variables that the code can use include: 2023-12-04T20:02:15,544 - `PGDATABASE`: The name of the PostgreSQL database you use. 2023-12-04T20:02:15,545 - `PGUSER`: Your username on the PostgreSQL database. 2023-12-04T20:02:15,545 - `PGHOST`: Where the PostgreSQL database is to be found (this will be `localhost` if its on the same machine as you're running the code on) 2023-12-04T20:02:15,546 - `WRDS_ID`: Your [WRDS](https://wrds-web.wharton.upenn.edu/wrds/) ID. 2023-12-04T20:02:15,547 I set these environment variables in `~/.profile`: 2023-12-04T20:02:15,548 ``` 2023-12-04T20:02:15,549 export PGHOST="localhost" 2023-12-04T20:02:15,550 export PGDATABASE="crsp" 2023-12-04T20:02:15,550 export WRDS_ID="iangow" 2023-12-04T20:02:15,551 export PGUSER="igow" 2023-12-04T20:02:15,552 ``` 2023-12-04T20:02:15,553 ## Using the function `wrds_update`. 2023-12-04T20:02:15,554 Two arguments `table_name` and `schema` are required. 2023-12-04T20:02:15,555 ### 1. WRDS Settings 2023-12-04T20:02:15,555 Set `WRDS_ID` using either `wrds_id=your_wrds_id` in the function call or the environment variable `WRDS_ID`. 2023-12-04T20:02:15,557 ### 2. Environment variables 2023-12-04T20:02:15,557 The software will use the environment variables `PGHOST`, `PGDATABASE`, and `PGUSER` if you If you have set them. Otherwise, you need to provide values as arguments to `wrds_udpate()`. Default `PGPORT` is`5432`. 2023-12-04T20:02:15,558 ### 3. Table settings 2023-12-04T20:02:15,559 To tailor your request, specify the following arguments: 2023-12-04T20:02:15,560 - `fix_missing`: set to `True` to fix missing values. This addresses special missign values, which SAS's `PROC EXPORT` dumps as strings. Default value is `False`. 2023-12-04T20:02:15,560 - `fix_cr`: set to `True` to fix characters. Default value is `False`. 2023-12-04T20:02:15,561 - `drop`: add column names to be dropped (e.g., `drop="id name"` will drop columns `id` and `name`). 2023-12-04T20:02:15,562 - `obs`: add maxium number of observations (e.g., `obs=10` will import the first 10 rows from the table on WRDS). 2023-12-04T20:02:15,562 - `rename`: rename columns (e.g., `rename="fee=mngt_fee"` renames `fee` to `mngt_fee`). 2023-12-04T20:02:15,563 - `force`: set to `True` to force update. Default value is `False`. 2023-12-04T20:02:15,564 ## Importing SAS data into PostgreSQL 2023-12-04T20:02:15,564 The software can also upload SAS file directly to PostgreSQL. 2023-12-04T20:02:15,565 You need to have local SAS in order to use this function. 2023-12-04T20:02:15,565 Use `fpath` to specify the path to the file to be imported 2023-12-04T20:02:15,566 ### Examples 2023-12-04T20:02:15,567 Here are some examples. 2023-12-04T20:02:15,567 If you are at the home directory of this git repo, you can import and use the software as shown below. 2023-12-04T20:02:15,568 To install it from Github: 2023-12-04T20:02:15,569 ``` 2023-12-04T20:02:15,570 sudo -H pip3 install git+https://github.com/iangow/wrds2pg --upgrade 2023-12-04T20:02:15,571 ``` 2023-12-04T20:02:15,572 This software is also available from PyPI. To install it from [PyPI](https://pypi.org/project/wrds2pg/): 2023-12-04T20:02:15,573 ``` 2023-12-04T20:02:15,573 pip3 install wrds2pg 2023-12-04T20:02:15,574 ``` 2023-12-04T20:02:15,574 Example usage: 2023-12-04T20:02:15,574 ```py 2023-12-04T20:02:15,575 from wrds2pg import wrds_update 2023-12-04T20:02:15,576 # 1. Download crsp.mcti from wrds and upload to pg as crps.mcti 2023-12-04T20:02:15,577 # Simplest version 2023-12-04T20:02:15,577 wrds_update(table_name="mcti", schema="crsp") 2023-12-04T20:02:15,578 # Tailored arguments 2023-12-04T20:02:15,579 wrds_update(table_name="mcti", schema="crsp", host=your_pghost, 2023-12-04T20:02:15,579 dbname=your_pg_database, 2023-12-04T20:02:15,580 fix_missing=True, fix_cr=True, drop="b30ret b30ind", obs=10, 2023-12-04T20:02:15,581 rename="caldt=calendar_date", force=True) 2023-12-04T20:02:15,582 # 2. Upload test.sas7dbat to pg as crsp.mcti 2023-12-04T20:02:15,582 wrds_update(table_name="mcti", schema="crsp", fpath="your_path/test.sas7dbat") 2023-12-04T20:02:15,583 ``` 2023-12-04T20:02:15,584 ### Report bugs 2023-12-04T20:02:15,585 Author: Ian Gow, 2023-12-04T20:02:15,585 Contributor: Jingyu Zhang, 2023-12-04T20:02:15,586 running dist_info 2023-12-04T20:02:15,587 creating /tmp/pip-modern-metadata-5i6c9uhq/wrds2pg.egg-info 2023-12-04T20:02:15,587 writing /tmp/pip-modern-metadata-5i6c9uhq/wrds2pg.egg-info/PKG-INFO 2023-12-04T20:02:15,588 writing dependency_links to /tmp/pip-modern-metadata-5i6c9uhq/wrds2pg.egg-info/dependency_links.txt 2023-12-04T20:02:15,588 writing requirements to /tmp/pip-modern-metadata-5i6c9uhq/wrds2pg.egg-info/requires.txt 2023-12-04T20:02:15,589 writing top-level names to /tmp/pip-modern-metadata-5i6c9uhq/wrds2pg.egg-info/top_level.txt 2023-12-04T20:02:15,590 writing manifest file '/tmp/pip-modern-metadata-5i6c9uhq/wrds2pg.egg-info/SOURCES.txt' 2023-12-04T20:02:15,590 reading manifest file '/tmp/pip-modern-metadata-5i6c9uhq/wrds2pg.egg-info/SOURCES.txt' 2023-12-04T20:02:15,591 adding license file 'LICENCE' 2023-12-04T20:02:15,591 writing manifest file '/tmp/pip-modern-metadata-5i6c9uhq/wrds2pg.egg-info/SOURCES.txt' 2023-12-04T20:02:15,592 creating '/tmp/pip-modern-metadata-5i6c9uhq/wrds2pg-1.0.27.dist-info' 2023-12-04T20:02:15,774 Preparing metadata (pyproject.toml): finished with status 'done' 2023-12-04T20:02:15,970 Source in /tmp/pip-wheel-6b60r1ui/wrds2pg_6804d3555af0497caa672f0dbe0b5218 has version 1.0.27, which satisfies requirement wrds2pg==1.0.27 from https://files.pythonhosted.org/packages/74/0a/7d02353b0ab90e16e9e25c24b22479b5e970eb71bd0112e3551b82b8a83d/wrds2pg-1.0.27.tar.gz 2023-12-04T20:02:15,978 Removed wrds2pg==1.0.27 from https://files.pythonhosted.org/packages/74/0a/7d02353b0ab90e16e9e25c24b22479b5e970eb71bd0112e3551b82b8a83d/wrds2pg-1.0.27.tar.gz from build tracker '/tmp/pip-build-tracker-qv5f50bh' 2023-12-04T20:02:16,261 Created temporary directory: /tmp/pip-unpack-3eac__4k 2023-12-04T20:02:16,263 Created temporary directory: /tmp/pip-unpack-o034dydz 2023-12-04T20:02:16,272 Building wheels for collected packages: wrds2pg 2023-12-04T20:02:16,276 Created temporary directory: /tmp/pip-wheel-dadztq4g 2023-12-04T20:02:16,277 Destination directory: /tmp/pip-wheel-dadztq4g 2023-12-04T20:02:16,279 Building wheel for wrds2pg (pyproject.toml): started 2023-12-04T20:02:16,281 Running command Building wheel for wrds2pg (pyproject.toml) 2023-12-04T20:02:17,050 # WRDS (or SAS) to PostgreSQL 2023-12-04T20:02:17,050 This software has two functions: 2023-12-04T20:02:17,051 - Download tables from [WRDS](https://wrds-web.wharton.upenn.edu/wrds/) and feed them to a PostgreSQL database. (Requires access to WRDS and to the data in question.) 2023-12-04T20:02:17,052 - Import a SAS file (`*.sas7dbat`) into a PostgreSQL database. 2023-12-04T20:02:17,054 ## Requirements 2023-12-04T20:02:17,057 ### 1. Python 2023-12-04T20:02:17,058 The software uses Python 3 and depends on Pandas, SQLAlchemy and Paramiko. In addition, the Python scripts generally interact with PostgreSQL using SQLAlchemy and the [Psycopg](http://initd.org/psycopg/) library. 2023-12-04T20:02:17,059 These dependencies are installed when you use Pip (see instructions below). 2023-12-04T20:02:17,062 ### 2. A WRDS ID 2023-12-04T20:02:17,063 To use public-key authentication to access WRDS, follow hints taken from [here](https://debian-administration.org/article/152/Password-less_logins_with_OpenSSH) to set up a public key. 2023-12-04T20:02:17,064 Copy that key to the WRDS server from the terminal on your computer. 2023-12-04T20:02:17,066 (Note that this code assumes you have a directory `.ssh` in your home directory. If not, log into WRDS via SSH, then type `mkdir ~/.ssh` to create this.) 2023-12-04T20:02:17,067 Here's code (for me) to create the key and send it to WRDS: 2023-12-04T20:02:17,068 ``` 2023-12-04T20:02:17,105 ssh-keygen -t rsa 2023-12-04T20:02:17,106 cat ~/.ssh/id_rsa.pub | ssh iangow@wrds-cloud.wharton.upenn.edu "cat >> ~/.ssh/authorized_keys" 2023-12-04T20:02:17,107 ``` 2023-12-04T20:02:17,107 Use an empty passphrase in setting up the key so that the scripts can run without user intervention. 2023-12-04T20:02:17,109 ### 3. PostgreSQL 2023-12-04T20:02:17,110 You should have a PostgreSQL database to store the data. 2023-12-04T20:02:17,111 ### 4. Environment variables 2023-12-04T20:02:17,113 Environment variables that the code can use include: 2023-12-04T20:02:17,115 - `PGDATABASE`: The name of the PostgreSQL database you use. 2023-12-04T20:02:17,116 - `PGUSER`: Your username on the PostgreSQL database. 2023-12-04T20:02:17,117 - `PGHOST`: Where the PostgreSQL database is to be found (this will be `localhost` if its on the same machine as you're running the code on) 2023-12-04T20:02:17,118 - `WRDS_ID`: Your [WRDS](https://wrds-web.wharton.upenn.edu/wrds/) ID. 2023-12-04T20:02:17,121 I set these environment variables in `~/.profile`: 2023-12-04T20:02:17,123 ``` 2023-12-04T20:02:17,125 export PGHOST="localhost" 2023-12-04T20:02:17,126 export PGDATABASE="crsp" 2023-12-04T20:02:17,127 export WRDS_ID="iangow" 2023-12-04T20:02:17,129 export PGUSER="igow" 2023-12-04T20:02:17,129 ``` 2023-12-04T20:02:17,130 ## Using the function `wrds_update`. 2023-12-04T20:02:17,131 Two arguments `table_name` and `schema` are required. 2023-12-04T20:02:17,132 ### 1. WRDS Settings 2023-12-04T20:02:17,133 Set `WRDS_ID` using either `wrds_id=your_wrds_id` in the function call or the environment variable `WRDS_ID`. 2023-12-04T20:02:17,134 ### 2. Environment variables 2023-12-04T20:02:17,135 The software will use the environment variables `PGHOST`, `PGDATABASE`, and `PGUSER` if you If you have set them. Otherwise, you need to provide values as arguments to `wrds_udpate()`. Default `PGPORT` is`5432`. 2023-12-04T20:02:17,136 ### 3. Table settings 2023-12-04T20:02:17,136 To tailor your request, specify the following arguments: 2023-12-04T20:02:17,137 - `fix_missing`: set to `True` to fix missing values. This addresses special missign values, which SAS's `PROC EXPORT` dumps as strings. Default value is `False`. 2023-12-04T20:02:17,138 - `fix_cr`: set to `True` to fix characters. Default value is `False`. 2023-12-04T20:02:17,138 - `drop`: add column names to be dropped (e.g., `drop="id name"` will drop columns `id` and `name`). 2023-12-04T20:02:17,139 - `obs`: add maxium number of observations (e.g., `obs=10` will import the first 10 rows from the table on WRDS). 2023-12-04T20:02:17,140 - `rename`: rename columns (e.g., `rename="fee=mngt_fee"` renames `fee` to `mngt_fee`). 2023-12-04T20:02:17,140 - `force`: set to `True` to force update. Default value is `False`. 2023-12-04T20:02:17,141 ## Importing SAS data into PostgreSQL 2023-12-04T20:02:17,142 The software can also upload SAS file directly to PostgreSQL. 2023-12-04T20:02:17,142 You need to have local SAS in order to use this function. 2023-12-04T20:02:17,142 Use `fpath` to specify the path to the file to be imported 2023-12-04T20:02:17,143 ### Examples 2023-12-04T20:02:17,144 Here are some examples. 2023-12-04T20:02:17,145 If you are at the home directory of this git repo, you can import and use the software as shown below. 2023-12-04T20:02:17,146 To install it from Github: 2023-12-04T20:02:17,147 ``` 2023-12-04T20:02:17,147 sudo -H pip3 install git+https://github.com/iangow/wrds2pg --upgrade 2023-12-04T20:02:17,148 ``` 2023-12-04T20:02:17,149 This software is also available from PyPI. To install it from [PyPI](https://pypi.org/project/wrds2pg/): 2023-12-04T20:02:17,150 ``` 2023-12-04T20:02:17,151 pip3 install wrds2pg 2023-12-04T20:02:17,151 ``` 2023-12-04T20:02:17,152 Example usage: 2023-12-04T20:02:17,152 ```py 2023-12-04T20:02:17,153 from wrds2pg import wrds_update 2023-12-04T20:02:17,154 # 1. Download crsp.mcti from wrds and upload to pg as crps.mcti 2023-12-04T20:02:17,154 # Simplest version 2023-12-04T20:02:17,155 wrds_update(table_name="mcti", schema="crsp") 2023-12-04T20:02:17,156 # Tailored arguments 2023-12-04T20:02:17,156 wrds_update(table_name="mcti", schema="crsp", host=your_pghost, 2023-12-04T20:02:17,157 dbname=your_pg_database, 2023-12-04T20:02:17,157 fix_missing=True, fix_cr=True, drop="b30ret b30ind", obs=10, 2023-12-04T20:02:17,158 rename="caldt=calendar_date", force=True) 2023-12-04T20:02:17,159 # 2. Upload test.sas7dbat to pg as crsp.mcti 2023-12-04T20:02:17,159 wrds_update(table_name="mcti", schema="crsp", fpath="your_path/test.sas7dbat") 2023-12-04T20:02:17,160 ``` 2023-12-04T20:02:17,161 ### Report bugs 2023-12-04T20:02:17,161 Author: Ian Gow, 2023-12-04T20:02:17,162 Contributor: Jingyu Zhang, 2023-12-04T20:02:17,163 running bdist_wheel 2023-12-04T20:02:17,163 running build 2023-12-04T20:02:17,164 running build_py 2023-12-04T20:02:17,164 creating build 2023-12-04T20:02:17,165 creating build/lib 2023-12-04T20:02:17,166 creating build/lib/wrds2pg 2023-12-04T20:02:17,166 copying wrds2pg/__init__.py -> build/lib/wrds2pg 2023-12-04T20:02:17,167 copying wrds2pg/wrds2pg.py -> build/lib/wrds2pg 2023-12-04T20:02:17,178 installing to build/bdist.linux-armv7l/wheel 2023-12-04T20:02:17,178 running install 2023-12-04T20:02:17,203 running install_lib 2023-12-04T20:02:17,209 creating build/bdist.linux-armv7l 2023-12-04T20:02:17,210 creating build/bdist.linux-armv7l/wheel 2023-12-04T20:02:17,212 creating build/bdist.linux-armv7l/wheel/wrds2pg 2023-12-04T20:02:17,213 copying build/lib/wrds2pg/__init__.py -> build/bdist.linux-armv7l/wheel/wrds2pg 2023-12-04T20:02:17,215 copying build/lib/wrds2pg/wrds2pg.py -> build/bdist.linux-armv7l/wheel/wrds2pg 2023-12-04T20:02:17,218 running install_egg_info 2023-12-04T20:02:17,229 running egg_info 2023-12-04T20:02:17,234 writing wrds2pg.egg-info/PKG-INFO 2023-12-04T20:02:17,237 writing dependency_links to wrds2pg.egg-info/dependency_links.txt 2023-12-04T20:02:17,239 writing requirements to wrds2pg.egg-info/requires.txt 2023-12-04T20:02:17,241 writing top-level names to wrds2pg.egg-info/top_level.txt 2023-12-04T20:02:17,248 reading manifest file 'wrds2pg.egg-info/SOURCES.txt' 2023-12-04T20:02:17,250 adding license file 'LICENCE' 2023-12-04T20:02:17,252 writing manifest file 'wrds2pg.egg-info/SOURCES.txt' 2023-12-04T20:02:17,254 Copying wrds2pg.egg-info to build/bdist.linux-armv7l/wheel/wrds2pg-1.0.27-py3.11.egg-info 2023-12-04T20:02:17,266 running install_scripts 2023-12-04T20:02:17,282 creating build/bdist.linux-armv7l/wheel/wrds2pg-1.0.27.dist-info/WHEEL 2023-12-04T20:02:17,285 creating '/tmp/pip-wheel-dadztq4g/.tmp-xng6bz_y/wrds2pg-1.0.27-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-12-04T20:02:17,287 adding 'wrds2pg/__init__.py' 2023-12-04T20:02:17,291 adding 'wrds2pg/wrds2pg.py' 2023-12-04T20:02:17,293 adding 'wrds2pg-1.0.27.dist-info/LICENCE' 2023-12-04T20:02:17,295 adding 'wrds2pg-1.0.27.dist-info/METADATA' 2023-12-04T20:02:17,296 adding 'wrds2pg-1.0.27.dist-info/WHEEL' 2023-12-04T20:02:17,297 adding 'wrds2pg-1.0.27.dist-info/top_level.txt' 2023-12-04T20:02:17,298 adding 'wrds2pg-1.0.27.dist-info/RECORD' 2023-12-04T20:02:17,299 removing build/bdist.linux-armv7l/wheel 2023-12-04T20:02:17,391 Building wheel for wrds2pg (pyproject.toml): finished with status 'done' 2023-12-04T20:02:17,396 Created wheel for wrds2pg: filename=wrds2pg-1.0.27-py3-none-any.whl size=10354 sha256=9223e74c2cf7a6963dbc89981ef07efd322784dbd6bb2cc34f41285784657ddf 2023-12-04T20:02:17,397 Stored in directory: /tmp/pip-ephem-wheel-cache-qex78mtq/wheels/a6/35/9a/ecc0c1ceba795c5872c7d873e72c96577f71f67dde2740e47d 2023-12-04T20:02:17,407 Successfully built wrds2pg 2023-12-04T20:02:17,411 Removed build tracker: '/tmp/pip-build-tracker-qv5f50bh'