deepcrawl-robots

A package to bulk match urls to robots.txt files

Installation

sudo pip3 install deepcrawl-robots

Should I use sudo? pip or pip3?

Releases

Version Released Stretch
Python 3.5
Buster
Python 3.7
Bullseye
Python 3.9
Files
0.0.5 2020-12-19      
0.0.4 2020-12-19      
0.0.3 2020-12-19      
0.0.2 2020-12-19      
0.0.1 2020-12-19      

Issues with this package?

Page last updated 2022-03-28 18:47:32 UTC