Is Python good for web crawlers?

Tempo bradfordh at gmail.com
Tue Feb 7 11:33:28 EST 2006


I was wondering if python is a good language to build a web crawler
with? For example, to construct a program that will routinely search x
amount of sites to check the availability of a product. Or to search
for news articles containing the word 'XYZ'. These are just random
ideas to try to explain my question a bit further. Well if you have an
opinion about this please let me know becasue I am very interested to
hear what you have to say. Thanks.




More information about the Python-list mailing list