crawlers in python with graphing?

[George Sakkis]

bryan rasmussen wrote:
> Hi,
>
> Sorry, was imprecise, I meant not save the downloaded page locally.
> There probably isn't one though, so I should build one myself.
> Probably just need a good crawler that can be set to dump all links
> into dataset that I can analyse with R.
>
> Cheers,
> Bryan Rasmussen

Harvestman (http://harvestman.freezope.org/) is your best bet.

George