[issue16099] robotparser doesn't support request rate and crawl delay parameters

[Hynek Schlawack]

Changes by Hynek Schlawack <hs at ox.cx>:


----------
nosy: +hynek

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue16099>
_______________________________________