trouble getting google through urllib

Will McGugan will at willNOmcguganSPAM.com
Tue Dec 19 03:13:34 EST 2006


Dr. Locke Z2A wrote:

> Does anyone know how I would get the bot to have permission to get the
> url? When I put the url in on firefox it works fine. I noticed that in
> the output html that google gave me it replaced some of the characters
> in the url with different stuff like the "&amp" and "%7C", so I'm
> thinking thats the problem, does anyone know how I would make it keep
> the url as I intended it to be?
> 

Google doesnt like Python scripts. You will need to pretend to be a 
browser by setting the user-agent string in the HTTP header.

Will McGugan
-- 
blog: http://www.willmcgugan.com



More information about the Python-list mailing list