[issue16099] robotparser doesn't support request rate and crawl delay parameters

[Berker Peksag]

Changes by Berker Peksag <berker.peksag at gmail.com>:


----------
assignee:  -> berker.peksag

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue16099>
_______________________________________