pcrawler

python版本的爬虫程序。根据java版本的webmagic改编而成。该爬虫程序主要包含downloader、storage、processor、schemular等四大功能模块。通过该爬虫程序可以快速的编写一个自定义的爬虫程序。

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install pcrawler

Dependencies

  • None

Releases

Version Released Bookworm
Python 3.11
Trixie
Python 3.13
Files
0.0.3 2019-06-22
0.0.2 2018-09-26

Issues with this package?

Page last updated 2026-09-03 00:25:04 UTC