Get entire web page?
Thomas A. Bryan
tbryan at python.net
Wed Nov 8 06:29:21 EST 2000
What does this button do? wrote:
>
> In article <8u01o1$jdv$1 at nnrp1.deja.com>,
> Whatdoesthisbuttondo? <fuzzydice at my-deja.com> wrote:
> > I'm trying to write a script so that I can do a throughput test for a
> > firewall/proxy. I know how to grab the text of a page, what I'm not
> .snip.
>
> Thanks for the followups. I've come to realize my python'ing
> limitations and will work on this as a learning project. For the short
> term I'll probably wire a few utils together to get some data.
> When I do get something passable I'll throw it out to the community for
> heckling ..er, constructive feedback
> :)
Did you notice Tools/webchecker/websucker.py in the standard
Python distribution. It can suck down mulitple pages for one
site. I often use it to grab multi-page documents off of the
web for local reading. I don't remember whether it correctly
grabs the image files too. If you'd like to use this problem
as a learning experience, you might be interested in at least
looking at websucker.py.
---Tom
More information about the Python-list
mailing list