Async Client with 1K connections?

Paul Rubin http
Tue Feb 10 03:30:06 EST 2004


williamichang at hotmail.com (William Chang) writes:
> I need extremely efficient and robust _client_ software for some
> common protocols like HTTP and POP3, supporting 1,000 simultaneous
> independent connections and commensurate network throughput.  The data
> get written to files or sockets, so no GUI needed.

You're writing a monstrous web spider in Python?

> I am not a Python programmer :-( but I am a "fan" :-) and I have been
> reading about asyncore/Medusa/Twisted -- which would be my best bet?

With enough hardware, you can do practically anything.  Some Apache
servers fork off that many processes.



More information about the Python-list mailing list