[issue36207] robotsparser deny all with some rules

[amiir mascud]

amiir mascud <amiir.mascud at intrees.org> added the comment:

Can you share the robot file that you are using for your website?
I am using the default robot file for my site https://meilleurdumoniteur.fr/

----------
nosy: +amiir.mascud

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36207>
_______________________________________