stealth screen scraping with python?

Steven D'Aprano steve at REMOVE.THIS.cybersource.com.au
Fri May 11 23:41:12 EDT 2007


On Fri, 11 May 2007 12:32:55 -0700, different.engine wrote:

> Folks:
> 
> I am screen scraping a large volume of data from Yahoo Finance each
> evening, and parsing with Beautiful Soup.
> 
> I was wondering if anyone could give me some pointers on how to make
> it less obvious to Yahoo that this is what I am doing, as I fear that
> they probably monitor for this type of activity, and will soon ban my
> IP.

Write a virus to hijack tens of thousands of Windows PCs around the world,
and use your army of zombie-PCs to do the screen scraping for you. Each
one only needs to scrape a small amount of data, and Yahoo will have no
way of telling that it is you.

*wink*

-- 
Steven.




More information about the Python-list mailing list