[Catalog-sig] Proposal: Move PyPI static data to the cloud for better availability

[M.-A. Lemburg]

Alexis Métaireau wrote:
> Hello,
> 
> Firstly, as Tarek said in another thread, I'm afraid this kill the PEP381
> about making a mirroring infrastructure.
> Having a infrastructure hosted on a cloud platform may be confortable, and
> probably needed to have a 24/7 running system, but
> we need to take care of letting possible the creation of new public mirrors,
> outside from the Amazon (or whatever) cloud infrastructure.

The proposal doesn't prevent that. However, please note that
setting up public mirrors not under PSF control has its own
set of (legal) problems, which the PSF hosted cloud setup avoids.

> On Tue, Jun 15, 2010 at 1:49 PM, M.-A. Lemburg <mal at egenix.com> wrote:
>>
>> PyPI is currently run from a single server hosted in The Netherlands
>> (ximinez.python.org).  This server is run by a very small team of sys
>> admin.
>>
> 
> As Martin von Löwis said, this already exists. "a.mirrors.pypi.python.org
>  and b.mirrors.pypi.python.org are already there and could be used by
> clients". Maybe Martin can you explain us (apologies if this is already done
> somewhere) how things are working from now ? Is this possible to rely on the
> existing work rather than using a cloud system ? What's the in place
> infrastructure ?

In order to use those two servers, you'd still need to implement
the redirection changes or client side tool changes and, what's
more important, you'd need to administer and monitor those servers
24/7 to achieve similar uptime.

The latter is what the proposal is all about: we're outsourcing
the administration and monitoring to a service provider.

-- 
Marc-Andre Lemburg
eGenix.com

Professional Python Services directly from the Source  (#1, Jun 15 2010)
>>> Python/Zope Consulting and Support ...        http://www.egenix.com/
>>> mxODBC.Zope.Database.Adapter ...             http://zope.egenix.com/
>>> mxODBC, mxDateTime, mxTextTools ...        http://python.egenix.com/
________________________________________________________________________
2010-07-19: EuroPython 2010, Birmingham, UK                33 days to go

::: Try our new mxODBC.Connect Python Database Interface for free ! ::::


   eGenix.com Software, Skills and Services GmbH  Pastor-Loeh-Str.48
    D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg
           Registered at Amtsgericht Duesseldorf: HRB 46611
               http://www.egenix.com/company/contact/