[Patches] [ python-Patches-499513 ] robotparser.py fails on some URLs
SourceForge.net
noreply@sourceforge.net
Mon, 19 May 2003 23:19:56 -0700
Patches item #499513, was opened at 2002-01-04 19:21
Message generated for change (Comment added) made by loewis
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=305470&aid=499513&group_id=5470
Category: Library (Lib)
Group: None
>Status: Closed
Resolution: Accepted
Priority: 5
Submitted By: Bastian Kleineidam (calvin)
Assigned to: Martin v. Löwis (loewis)
Summary: robotparser.py fails on some URLs
Initial Comment:
I am using Python 2.1.1.
The URL http://www.chaosreigns.com/robots.txt results
in an empty RobotParser object.
Reason is that the file object returned from the
URLOpener does not have a readlines() attribute.
I patched the robotparser.py to use readline() instead
of readlines().
Furthermore I removed the unnecessary redirection limit
code which is already in FancyURLopener.
Greetings, Bastian
----------------------------------------------------------------------
>Comment By: Martin v. Löwis (loewis)
Date: 2003-05-20 08:19
Message:
Logged In: YES
user_id=21627
Backport committed as 1.10.16.1.
----------------------------------------------------------------------
Comment By: Martin v. Löwis (loewis)
Date: 2003-05-20 00:32
Message:
Logged In: YES
user_id=21627
Backport to 2.2.
----------------------------------------------------------------------
Comment By: Martin v. Löwis (loewis)
Date: 2002-03-18 11:43
Message:
Logged In: YES
user_id=21627
Thanks for the patch. Committed as robotparser.py 1.12.
----------------------------------------------------------------------
Comment By: Bastian Kleineidam (calvin)
Date: 2002-01-04 20:02
Message:
Logged In: YES
user_id=9205
Updated patch with copyright
----------------------------------------------------------------------
Comment By: Guido van Rossum (gvanrossum)
Date: 2002-01-04 19:49
Message:
Logged In: YES
user_id=6380
I'll gladly apply your patch.
Would you mind to also supply a patch for the copyright
statement?
It says "Python 2.0 open source license" but that's no
longer the current license. How about the PSF license
agreement for Python 2.2?
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=305470&aid=499513&group_id=5470