ANN - HarvestMan 1.2 alpha

Anand Pillai pythonguy@Hotpop.com
4 Sep 2003 11:12:51 -0700


HarvestMan is a full-featured, multithreaded, multiprotocol,
and customizable web crawler written in python. It is
currently in version 1.1 and supports as much as 35 different
end user options for customization.

The version 1.2 (alpha) is available for download
at the HarvestMan project page below.

URL=> http://sithara.freezope.org/harvestman/source

This release adds Cookie support based on RFC 2109 and
also Caching of files/pages. A new fetchlevel is added
and many bugs have been fixed.

This is the first release on the road to 1.2 final release.

Send your comments/bug reports to authors.

Thanks.

-Anand Pillai