How to spider through a secure site?

[Gardner Pomper]

Thanks, I tried googling 'python ssl certificate' and I am still not finding
answers.

I think part of my problem is that I am not clear on what is going on under
the covers. I have found an example of connecting via https
here<http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/117004>but
that seems to require a "certificate file", which I don't have (that I
am aware of).

When I point my web browser at the infinite campus URL, it first responds
with a certificate warning, saying that the certificate might be registered
to a different site. So, this must be where the server is sending the
certificate file to my browser. If I could capture and save that file, I
could then probably use the example mentioned above with
httplib.HTTPSConnection() to connect to the server.

So, I guess my question comes down to how do I connect to the first URL,
without a certificate file, and then receive the response back with the
certificate file, so that I can then reconnect using the certificate?

Anyone have some sample code out there for this?

- Gardner

On Dec 20, 2007 10:26 PM, Terry Reedy <tjreedy at udel.edu> wrote:

>
> "Gardner Pomper" <gardner at networknow.org> wrote in message
> news:42d22dbf0712201528u5048bbbu9046a88ea300e6f1 at mail.gmail.com...
> | Hi,
> |
> | My daughter's school just put up an "Infinite Campus" website, which
> | requires a login and does everything through https. I can find examples
> of
> | how to spider a regular web site with python, but I can't figure out how
> to
> | deal with the ssl certificate and how to supply name and password. I
> have
> | tried google, but I must not know the right terms.
>
> If you have not googled 'python ssl certificate', do so.
>
>
>
> --
> http://mail.python.org/mailman/listinfo/python-list
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-list/attachments/20071220/bdcabfb8/attachment.html>