[Catalog-sig] PyPI down?

[Sridhar Ratnakumar]

On 1/11/2010 1:45 PM, Terry Reedy wrote:
> On 1/11/2010 3:41 PM, Chris Withers wrote:
>> Martin v. Löwis wrote:
>>>> Anyone know whassup with PyPI?
>>>
>>> Works fine for me.
>>
>> I'm still seeing really variable performance and only from PyPI. The
>> main python website and all other websites I've tried are fine.
>>
>> Are there any site load stats easily accessible? I wonder if someone is
>> maybe spidering PyPI in an antisocial way or some such...
>
> Currently, (4:18 est, Delaware, USA) I have gotten several pages with 1
> sec response.

The PyPM mirror program[1] runs at 0100hrs PST (= 0400hrs EST). What it 
does is to redownload the latest version of packages released in last 
two days (as reported by the `changelog` XMLRPC API). The download part 
is equivalent to running "easy_install $pkgname" sequentially - except 
duplicates are handled - for each of those packages and their 
dependencies. Only one XMLRPC API call is made per day.

I believe z3c.pypimirror - and soon PEP 381 - works in a similar fashion 
(except for less sophisticated scrapping logic).

It is not clear to me how this could overload the server. Does this 
happen everyday at the same time interval?

-srid

****
[1] apologies for not setting the user-agent string properly; I will get 
around to doing it tomorrow