robotexclusionrulesparser

A robots.txt parser alternative to Python's robotparser module

Installation

sudo pip3 install robotexclusionrulesparser

Should I use sudo? pip or pip3?

Releases

Version Released Stretch
Python 3.5
Buster
Python 3.7
Bullseye
Python 3.9
Files
1.7.1 2016-08-12      
1.7.0 2015-12-29      
1.6.2 2014-03-25      

Issues with this package?

Page last updated 2022-03-28 15:13:51 UTC