piwheels

scrawler

Tool for General Purpose Web Scraping and Crawling

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install scrawler

Dependencies

• readability-lxml
• tld
• beautifulsoup4
• pandas
• python-dateutil
• aiohttp
• setuptools
• requests

Releases

Version	Released	Bookworm Python 3.11	Trixie Python 3.13	Files
0.3.1	2021-07-06
scrawler-0.3.1-py3-none-any.whl (39 KB)
0.3.0	2021-05-14
scrawler-0.3.0-py3-none-any.whl (39 KB)
0.2.1	2021-05-12
scrawler-0.2.1-py3-none-any.whl (43 KB)
0.2.0	2021-05-09
scrawler-0.2.0-py3-none-any.whl (43 KB)
0.1.1	2021-04-26
scrawler-0.1.1-py3-none-any.whl (43 KB)
0.1.0	2021-04-26
scrawler-0.1.0-py3-none-any.whl (43 KB)

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue