Does Python allow variables to be passed into function for dynamic screen scraping?

Steven D'Aprano steve at pearwood.info
Sat Nov 28 20:58:42 EST 2015


On Sun, 29 Nov 2015 09:03 am, ryguy7272 wrote:

> I'm looking at this URL.
> https://en.wikipedia.org/wiki/Wikipedia:Unusual_place_names

Don't screen-scrape Wikipedia. Just don't. They have an official API for
downloading content, use it. There's even a Python library for downloading
from Wikipedia and other Mediawiki sites:

https://www.mediawiki.org/wiki/Manual:Pywikibot

Wikimedia does a fantastic job, for free, and automated screen-scraping
hurts their ability to provide that service. It is rude and anti-social.
Please don't do it.



-- 
Steven




More information about the Python-list mailing list