[Tutor] Interfacing to the web

Magnus Lycka magnus@thinkware.se
Wed Oct 23 17:21:01 2002


At 13:03 2002-10-23 -0400, andy surany wrote:
>Hi All!
>
>Here is what I need to accomplish:
>
>     From a python program, I need to launch a browser. The user then uses=
=20
> the browser to interact with the web site. However, the python program=20
> must continually monitor the data from the web site to capture specific=20
> data elements.
>
>     Unfortunately, I can't point the program to the specific URL as there=
=20
> is a significant and secure (cookies, etc.) exchange that must occur in=20
> order to reach the page.

I see two reasonable ways to go about this.

One is to use a web proxy that acts as a man-in-the-middle.
I'm not aware of any python proxies though, but maybe it's
possible tobuild plugins for some proxies? Something along
the line of privoxy (www.privoxy.org) or squid
(www.squid-cache.org) might be useful??? See
http://www.squid-cache.org/related-software.html

Another option could be to build a custom web browser.
If you use wxPython, there is a HTML window component
that could be useful. If you are in MS Windows, you
could also plug into Internet Explorer or at least
use parts of it. See the wxPython demo.


--=20
Magnus Lyck=E5, Thinkware AB
=C4lvans v=E4g 99, SE-907 50 UME=C5
tel: 070-582 80 65, fax: 070-612 80 65
http://www.thinkware.se/  mailto:magnus@thinkware.se