any suggestions for URL cataloging project?

[Alex Martelli]

Matthew K Jensen <matt.torment at gmail.com> wrote:

> I've just come up with an idea to make a small-time record of web
> pages linking to other web pages. I don't want to download every page
> on the internet (I'll leave google to do that). I just want to know if
> anyone has any suggestions on how to acquire just the links from a web
> page using python. This is for a cataloging purpose. Is there some
> library or script out there that I haven't heard of?

Check out Tools/webchecker/ -- the Tools directory is part of Python's
source distribution and should also come with most prepackaged Python
distributions, I believe.


Alex