[Catalog-sig] PyPI down again...

Tarek Ziadé ziade.tarek at gmail.com
Fri Jun 11 23:11:35 CEST 2010


On Fri, Jun 11, 2010 at 11:06 PM, M.-A. Lemburg <mal at egenix.com> wrote:
> "Martin v. Löwis" wrote:
>> For a smaller project, start putting mirror support into setuptools or
>> distribute; this would make short (several hours) outages less severe
>> for the class of users that want permanent availability for downloading.
>> It's unlikely that the mirrors would break when the master goes down;
>> they just stop mirroring.
>
> A better and cleaner strategy is to put the static PyPI information
> up on Amazon Cloudscape and have DNS take care of providing local
> mirrors (edge servers) to setuptools et al.
>
> Such a setup won't require any complicated mirror logic in any
> of the existing client tools.
>
> By moving the PyPI installation to Amazon AWS, we could also
> get the RPC access distributed to more than just one server.
>
> As I said before, the PSF infrastructure committee needs to get on
> of the job of getting this implemented (including funding this
> development).
>
> If someone wants to volunteer helping with the setup, please contact
> the PSF at psf at python.org.

What about continuing the work that was started last year ?
(and not finished due to a lack of time)

There's a PEP we have started about a mirroring infrastructure:
http://www.python.org/dev/peps/pep-0381/

Some of its parts are already implemented in PyPI, and
what we need now is to work on the client side (pip, distribute, etc)
and bootstrap one or two mirrors using the protocol.

Regards
Tarek


More information about the Catalog-SIG mailing list