simple-site-crawler

Simple website crawler that asynchronously crawls a website and all subpages that it can find, along with static content that they rely on.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install simple-site-crawler

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
0.1.1 2017-01-30  
0.1.0 2017-01-18  

Issues with this package?

Page last updated 2025-06-27 21:55:32 UTC