[issue25400] robotparser doesn't return crawl delay for default entry

[Berker Peksag]

Changes by Berker Peksag <berker.peksag at gmail.com>:


Added file: http://bugs.python.org/file44740/issue25400_v3.diff

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue25400>
_______________________________________