piwheels

python-multiprocess-crawler

Python BaseClass for easier multiprocess web-crawling

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install python-multiprocess-crawler

Dependencies

• user-agent
• bs4
• requests

Releases

Version	Released	Bookworm Python 3.11	Trixie Python 3.13	Files
1.6.4	2018-11-12
python_multiprocess_crawler-1.6.4-py3-none-any.whl (8 KB)
1.6.3	2018-11-12
python_multiprocess_crawler-1.6.3-py3-none-any.whl (8 KB)
1.6.2	2018-11-12
python_multiprocess_crawler-1.6.2-py3-none-any.whl (8 KB)
1.6.1	2018-11-12
python_multiprocess_crawler-1.6.1-py3-none-any.whl (8 KB)
1.6.0	2018-11-12
python_multiprocess_crawler-1.6.0-py3-none-any.whl (8 KB)
1.5.3	2018-10-01
python_multiprocess_crawler-1.5.3-py3-none-any.whl (4 KB)
1.5.2	2018-10-01
python_multiprocess_crawler-1.5.2-py3-none-any.whl (4 KB)
1.5.0	2018-09-28
python_multiprocess_crawler-1.5.0-py3-none-any.whl (3 KB)
1.4.5	2018-09-28
python_multiprocess_crawler-1.4.5-py3-none-any.whl (3 KB)
1.4.2	2018-09-08
python_multiprocess_crawler-1.4.2-py3-none-any.whl (3 KB)
1.4.1	2018-09-05
python_multiprocess_crawler-1.4.1-py3-none-any.whl (3 KB)
1.3.0	2018-09-05
python_multiprocess_crawler-1.3.0-py3-none-any.whl (3 KB)
1.1.0	2018-09-05
python_multiprocess_crawler-1.1.0-py3-none-any.whl (3 KB)
1.0.0	2018-09-05
python_multiprocess_crawler-1.0.0-py3-none-any.whl (3 KB)
0.0.1	2018-09-05
python_multiprocess_crawler-0.0.1-py3-none-any.whl (3 KB)

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue