[Tutor] need help; save web data

[Kent Johnson]

On Sat, Jun 28, 2008 at 9:54 PM, Michael Miesner
<michael.miesner at gmail.com> wrote:
> Hi all-
> I am trying to save the output of a web search to a local file, using
> python.
> Im really new to this, but I want to be able to write a program that uses
> google scholar, but takes search results and saves them to a local file.
> I am perfectly fine with playing around wtih this until I get it, but I dont
> know how to begin to get python to grab the output of a given search on
> google scholar and save it to a file.

You can use urllib2 to post to a web server and get the result back,
then use ordinary file save. I have some notes here:
http://personalpages.tds.net/~kent37/kk/00010.html

Note that this may be a violation of the Google Scholar terms of
service; I know it is a violation to automatically collect normal
Google search results, and IIRC Google takes some steps to make it
difficult as well.

Kent