[issue13281] robotparser.RobotFileParser ignores rules preceeded by a blank line
Petri Lehtinen
report at bugs.python.org
Fri Oct 28 07:43:24 CEST 2011
Petri Lehtinen <petri at digip.org> added the comment:
Blank lines are allowed according to the specification at http://www.robotstxt.org/norobots-rfc.txt, section 3.3 Formal Syntax.
The issue also seems to exist on 3.2 and 3.3.
----------
components: +Library (Lib)
keywords: +needs review
stage: -> patch review
versions: +Python 3.2, Python 3.3
_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue13281>
_______________________________________
More information about the Python-bugs-list
mailing list