[Catalog-sig] PyPI down

[Thomas Wouters]

On 8/1/07, "Martin v. Löwis" <martin at v.loewis.de> wrote:
>
> > Fixed, I think. The problem was actually a screen-scraper searching the
> > wiki (a third of the last 100k hits on the wiki were from the same host,
> > requesting every possible link on every possible page.) Someone with
> > more wiki knowledge may want to make sure no weird pages were made. (The
> > offending host was somewhere in dynamic.dsl.as9105.com
> > <http://dynamic.dsl.as9105.com>; I have the actual address but don't
> > want to mail it around.)
>
> Strange. According to the logs, it also happened (simultaneously,
> but independently?) that pypi.fcgi would always terminate
> immediately. This happened before, and I could never figure out
> why, so I added a mechanism to restart Apache. This time, the
> restart happened, and pypi.fcgi would again stop right away,
> to be restarted again, and so on.
>
> If this is indeed related to the load on MoinMoin, this is quite
> puzzling: they are separate processes, and separate virtual hosts.
> So they shouldn't "see" each other.


The load is machine load, which is of course shared across all processes. It
was about 15, with a slow response to match. Nullrouting that particular IP
address fixed the problem instantly, so I'm pretty sure that was it.

-- 
Thomas Wouters <thomas at python.org>

Hi! I'm a .signature virus! copy me into your .signature file to help me
spread!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.python.org/pipermail/catalog-sig/attachments/20070801/efe99e6c/attachment.html