web crawler in python or C?

[Steve Holden]

abhinav wrote:
> Hi guys.I have to implement a topical crawler as a part of my
> project.What language should i implement
> C or Python?Python though has fast development cycle but my concern is
> speed also.I want to strke a balance between development speed and
> crawler speed.Since Python is an interpreted language it is rather
> slow.The crawler which will be working on huge set of pages should be
> as fast as possible.One possible implementation would be implementing
> partly in C and partly in Python so that i can have best of both
> worlds.But i don't know to approach about it.Can anyone guide me on
> what part should i implement in C and what should be in Python?
> 
Get real. Any web crawler is bound to spend huge amounts of its time 
waiting for data to come in over network pipes. Or do you have plans for 
massive parallelism previously unheard of in the Python world?

regards
  Steve
-- 
Steve Holden       +44 150 684 7255  +1 800 494 3119
Holden Web LLC                     www.holdenweb.com
PyCon TX 2006                  www.python.org/pycon/