Simulating a Web Browser in Python
David Fisher
python at rose164.wuh.wustl.edu
Tue Mar 21 16:10:12 EST 2000
----- Original Message -----
From: "Brian Fritz" <brianfr at grace.speakeasy.org>
Newsgroups: comp.lang.python
To: <python-list at python.org>
Sent: Tuesday, March 21, 2000 1:37 PM
Subject: Re: Simulating a Web Browser in Python
>
> Well to make my intent a bit more clear... What I'm writing is going to
> be a Web Robot.
>
> However, I'd heard of grail and it may be a good source of example and
> howto code.
>
Well then, in the Tools directory of the Python source is webchecker. It
will traverse a web tree looking for bad links. In the same directory is
websucker, which will mirror a remote web site locally when pointed at the
root url. I use it all the time when I want to pull content from the web
and maintain it's structure.
dnf
More information about the Python-list
mailing list