Is Python good for web crawlers?

Alex Martelli aleaxit at yahoo.com
Wed Feb 8 10:56:05 EST 2006


Magnus Lycka <lycka at carmen.se> wrote:
   ...
> I dunno, but there are these two guys, Sergey Brin and Lawrence Page,
> who wrote a web crawler in Python. As far as I understood, they were
> fairly successful with it. I think they called their system Koogle,
> Bugle, or Gobble or something like that. Goo...can't remember.
> 
> See http://www-db.stanford.edu/~backrub/google.html

Yeah, I've heard of them, too.


> They've also employed some clever Python programmers, such as Greg
> Stein, Alex Martelli (isn't he a bot?) and some obscure dutch
> mathematician called Guido van something. It seems they still like
> Python.

Bot? me? did I fail a Turing test again without even noticing?!


Alex



More information about the Python-list mailing list