Open source web crawler with mysql integration

[Daniel Fetchinson]

> I'm looking for a crawler that can spider my site and toss the results
> into mysql so, in turn, that database can be indexed by Sphinx Search.
>
> Since I don't want to reinvent the wheel, is anyone aware of any open
> source projects or code snippets that can already handle this?

Have a look at http://nikitathespider.com/python/

HTH,
Daniel

-- 
Psss, psss, put it down! - http://www.cafepress.com/putitdown