http error 301 for urlopen

[John Nagle]

On 11/7/2010 5:51 PM, D'Arcy J.M. Cain wrote:
> On Sun, 7 Nov 2010 19:30:23 -0600
> Wenhuan Yu<yuwenhuan at gmail.com>  wrote:
>> I tried to open a link with urlopen:
>>
>> import urllib2
>> alink = "
>> http://feeds.nytimes.com/click.phdo?i=ff074d9e3895247a31e8e5efa5253183"
>> f = urllib2.urlopen(alink)
>> print f.read()
>>
>> and got the followinig error:
>>
>> urllib2.HTTPError: HTTP Error 301: The HTTP server returned a redirect error
>> that would lead to an infinite loop.
>> The last 30x error message was:
>> Moved Permanently
>>
>> I can open the link in browser. Any way to get solve this? Thanks.
>
> I checked with my tools and was told that it redirects more than five
> times.  Maybe it's not infinite but too many for urlopen.  Or, maybe
> the browser just ignores the extra redirects and the part of the page
> with the redirects isn't critical for viewing it.  I think that you are
> going to have to investigate the HTML manually and follow all the
> individual links to find the problem.  You may have to put in a bug
> request with the New York Times.  Good luck with that.

   It's the New York Times' paywall.  They're trying to set a cookie,
and will redirect the URL until you store and return the cookie.

				John Nagle