[issue25400] robotparser doesn't return crawl delay for default entry

[Berker Peksag]

Berker Peksag added the comment:

Thanks for the patch Peter(and welcome to Python and open source development). I have a WIP patch to rewrite test_robotparser in a less magic way. So we can ignore test failures for now. I'll take a closer look to your patch.

----------
stage:  -> patch review

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue25400>
_______________________________________