From jpiatlicki at gmail.com  Tue Aug 13 16:39:23 2013
From: jpiatlicki at gmail.com (Jauhien Piatlicki)
Date: Tue, 13 Aug 2013 14:39:23 -0000
Subject: [Pypi-checkins] Fetching data from PyPI
Message-ID: <CAGSpCeNdq6o2RNhVxo1GnJTm9O_LSUf6DZHkT=ou6YWUwD_z7w@mail.gmail.com>

Hi all,

I have a little question. I'm working on automated ebuild generator [1]. I
want to implement it for PyPI now. Is there any reliable way of fetching
information about all the available packages from PyPI? I need at least the
following data:

- package name
- package version
- license
- home page
- downloading url
- description
- dependencies (may be)

I'm aware of json and xmlrpc interfaces, but they do not work for me: PyPI
server begins to reject my queries (may be it thinks I do an attack )) ).
At the moment I'm just parsing HTML pages with the necessary information
[2], but it is quite ugly solution. So I will be thankful for any
suggestions.

[1] https://github.com/jauhien/g-sorcery
[2] https://github.com/jauhien/g-sorcery/blob/master/gs_pypi/pypi_db.py

Best regards,
Jauhien
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypi-checkins/attachments/20130813/e07e298a/attachment.html>