Does Python allow variables to be passed into function for dynamic screen scraping?

ryguy7272 ryanshuell at gmail.com
Sat Nov 28 23:52:59 EST 2015


On Saturday, November 28, 2015 at 8:59:04 PM UTC-5, Steven D'Aprano wrote:
> On Sun, 29 Nov 2015 09:03 am, ryguy7272 wrote:
> 
> > I'm looking at this URL.
> > https://en.wikipedia.org/wiki/Wikipedia:Unusual_place_names
> 
> Don't screen-scrape Wikipedia. Just don't. They have an official API for
> downloading content, use it. There's even a Python library for downloading
> from Wikipedia and other Mediawiki sites:
> 
> https://www.mediawiki.org/wiki/Manual:Pywikibot
> 
> Wikimedia does a fantastic job, for free, and automated screen-scraping
> hurts their ability to provide that service. It is rude and anti-social.
> Please don't do it.
> 
> 
> 
> -- 
> Steven

Thanks Steven.  Do you know of a good tutorial for learning about Wikipedia APIs?  I'm not sure where to get started on this topic.  I did some Google searches, but didn't come up with a lot of useful info...not much actually...



More information about the Python-list mailing list