"abhinav" <abhinavduggal at gmail.com> writes: > The crawler which will be working on huge set of pages should be > as fast as possible. What kind of network connection do you have, that's fast enough that even a fairly cpu-inefficient crawler won't saturate it?