[Python-Dev] funky buildbot problems again...

[Bill Janssen]

My Intel Snow Leopard 2 build slave has gone into outer-space again.

When I look at it, I see buildslave taking up most of a CPU (80%), and
nothing much else going on.  The twistd log says:

[... much omitted ...]
2011-04-04 08:35:47-0700 [-] sending app-level keepalive
2011-04-04 08:45:47-0700 [-] sending app-level keepalive
2011-04-04 08:55:47-0700 [-] sending app-level keepalive
2011-04-04 09:03:15-0700 [Broker,client] lost remote
2011-04-04 09:03:15-0700 [Broker,client] lost remote
2011-04-04 09:03:15-0700 [Broker,client] lost remote
2011-04-04 09:03:15-0700 [Broker,client] lost remote
2011-04-04 09:03:15-0700 [Broker,client] lost remote
2011-04-04 09:03:15-0700 [Broker,client] Lost connection to dinsdale.python.org:9020
2011-04-04 09:03:15-0700 [Broker,client] <twisted.internet.tcp.Connector instance at 0x101629ab8> will retry in 3 seconds
2011-04-04 09:03:15-0700 [Broker,client] Stopping factory <buildslave.bot.BotFactory instance at 0x1016299e0>
2011-04-04 09:03:18-0700 [-] Starting factory <buildslave.bot.BotFactory instance at 0x1016299e0>
2011-04-04 09:03:18-0700 [-] Connecting to dinsdale.python.org:9020
2011-04-04 09:03:18-0700 [Uninitialized] Connection to dinsdale.python.org:9020 failed: Connection Refused
2011-04-04 09:03:18-0700 [Uninitialized] <twisted.internet.tcp.Connector instance at 0x101629ab8> will retry in 8 seconds
2011-04-04 09:03:18-0700 [Uninitialized] Stopping factory <buildslave.bot.BotFactory instance at 0x1016299e0>
2011-04-04 09:03:27-0700 [-] Starting factory <buildslave.bot.BotFactory instance at 0x1016299e0>
2011-04-04 09:03:27-0700 [-] Connecting to dinsdale.python.org:9020

So it's been spinning its wheels for 3 days.

Sure looks like the connection attempt is failing, for some reason.

I'm using the stock Twisted that comes with Snow Leopard -- tried to
upgrade it but apparently can't.

On my OS X 10.4 buildslave, I see a similar but more successful sequence:

2011-04-04 08:56:06-0700 [-] sending app-level keepalive
2011-04-04 09:04:39-0700 [Broker,client] lost remote
2011-04-04 09:04:39-0700 [Broker,client] lost remote
2011-04-04 09:04:39-0700 [Broker,client] lost remote
2011-04-04 09:04:39-0700 [Broker,client] lost remote
2011-04-04 09:04:39-0700 [Broker,client] lost remote
2011-04-04 09:04:39-0700 [Broker,client] <twisted.internet.tcp.Connector instance at 0x10352d8> will retry in 3 seconds
2011-04-04 09:04:39-0700 [Broker,client] Stopping factory <buildslave.bot.BotFactory instance at 0x133bd78>
2011-04-04 09:04:42-0700 [-] Starting factory <buildslave.bot.BotFactory instance at 0x133bd78>
2011-04-04 09:04:43-0700 [Uninitialized] <twisted.internet.tcp.Connector instance at 0x10352d8> will retry in 10 seconds
2011-04-04 09:04:43-0700 [Uninitialized] Stopping factory <buildslave.bot.BotFactory instance at 0x133bd78>
2011-04-04 09:04:53-0700 [-] Starting factory <buildslave.bot.BotFactory instance at 0x133bd78>
2011-04-04 09:04:57-0700 [Broker,client] message from master: attached

Bill