[issue17403] Robotparser fails to parse some robots.txt
R. David Murray
report at bugs.python.org
Wed Mar 27 03:36:19 CET 2013
R. David Murray added the comment:
Well, the code is easy. Figuring out what the code is supposed to do turns out to be hard, but we didn't know that when we marked it as easy :)
I want to do more research before OKing a fix for this. (There is clearly a bug, I'm just not certain what the correct fix is.)
----------
nosy: +r.david.murray
_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue17403>
_______________________________________
More information about the Python-bugs-list
mailing list