Protego

Pure-Python robots.txt parser with support for modern conventions

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install protego

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
0.5.0 2025-06-24
0.4.0 2025-01-17    
0.3.1 2024-04-05    
0.3.0 2023-08-09  
0.2.1 2022-02-19  
0.2.0 2022-02-12  
0.1.16 2019-12-09  
0.1.15 2019-08-28  
0.1.14 2019-08-28  
0.1.12 2019-08-28  
0.1 2019-08-19  
0.1.dev0 pre-release 2019-07-18  

Issues with this package?

Page last updated 2025-06-24 14:04:54 UTC