[issue36207] robotsparser deny all with some rules
mathias44
report at bugs.python.org
Thu May 28 19:54:56 EDT 2020
mathias44 <contact at web-nantes.eu> added the comment:
I can't display my robot.TXT. I want to ban robots https://ereputation-dereferencement.fr/
----------
nosy: +mathias44
_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36207>
_______________________________________
More information about the Python-bugs-list
mailing list