Does Python allow variables to be passed into function for dynamic screen scraping?
Steven D'Aprano
steve at pearwood.info
Sat Nov 28 20:58:42 EST 2015
On Sun, 29 Nov 2015 09:03 am, ryguy7272 wrote:
> I'm looking at this URL.
> https://en.wikipedia.org/wiki/Wikipedia:Unusual_place_names
Don't screen-scrape Wikipedia. Just don't. They have an official API for
downloading content, use it. There's even a Python library for downloading
from Wikipedia and other Mediawiki sites:
https://www.mediawiki.org/wiki/Manual:Pywikibot
Wikimedia does a fantastic job, for free, and automated screen-scraping
hurts their ability to provide that service. It is rude and anti-social.
Please don't do it.
--
Steven
More information about the Python-list
mailing list