crawlers in python with graphing?

[bryan rasmussen]

Hi

I'm wondering if there is a toolkit in python anywhere for doing at a
high level web crawling, dumping links to a data set that could be
imported into R relatively easy or used in python natively to generate
a graph over the website.


It should hopefully be as high level as Wget, not download the pages
but just follow the links, and output graphs.



Cheers
Bryan Rasmussen