[New-bugs-announce] [issue12355] Crawler doesn't follow redirection

[Filip Gruszczyński]

New submission from Filip Gruszczyński <gruszczy at gmail.com>:

When looking at issue #12348 I have noticed following behaviour:

from packaging.pypi.simple import Crawler
c = Crawler()
c.get_releases('webob')

Traceback (most recent call last):
  File "test_crawl.py", line 3, in <module>
    c.get_releases('webob')
  File "/home/gruszczy/Projects/python/Lib/packaging/pypi/simple.py", line 192, in get_releases
    raise ProjectNotFound
packaging.pypi.errors.ProjectNotFound

This is because when request for /simple/webob/ is made 301 is returned to /simple/WebOb/ and HttpError raised, which is silenced and returned:

        except urllib.error.HTTPError as v:
            return v

Wouldn't it be good to do something about? How about crawler following redirects?

----------
assignee: tarek
components: Distutils2
messages: 138547
nosy: alexis, eric.araujo, gruszczy, tarek
priority: normal
severity: normal
status: open
title: Crawler doesn't follow redirection
type: crash
versions: Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue12355>
_______________________________________