[Tutor] Accessing query results html frame :The solution
Karim
karim.liateni at free.fr
Wed Feb 16 02:40:28 EST 2011
On 02/14/2011 01:41 PM, Karim wrote:
>
> Hello,
>
> As I get no response from the tutor python list, I am continuing to
> investigate my problem.
>
> In fact the issue is that there are 2 forms in the interactive page
> and my request does nothing
> instead I get the interactive page not the submission I asked (query
> results). The 2 forms are:
>
> 1. <FORM METHOD="POST" ACTION="/ddts/ddts_main"
> ENCTYPE="application/x-www-form-urlencoded" NAME="form1">
> 2. <FORM METHOD="POST" ACTION="/ddts/ddts_main"
> ENCTYPE="application/x-www-form-urlencoded" NAME="form9">
>
> And the parameters for each are:
>
> 1)
> <INPUT TYPE="hidden" NAME="init" VALUE="">
> <INPUT TYPE="hidden" NAME="LastForm" VALUE="SavedQuery">
> <INPUT TYPE="hidden" NAME="NextForm" VALUE="">
> <INPUT TYPE="hidden" NAME="REMOTE_USER" VALUE="karim.liateni">
> <INPUT TYPE="submit" NAME="ACTION" VALUE="Query">
> <INPUT TYPE="submit" NAME="ACTION" VALUE="Report">
> <INPUT TYPE="submit" NAME="ACTION" VALUE="Edit">
> <INPUT TYPE="submit" NAME="ACTION" VALUE="Delete">
> <INPUT TYPE="submit" NAME="ACTION" VALUE="Create"
> ONCLICK="oncreate()">
> <INPUT TYPE="submit" NAME="ACTION" VALUE="Create String Query">
> <INPUT TYPE="hidden" NAME=".cgifields" VALUE="personalQuery">
> <INPUT TYPE="hidden" NAME=".cgifields" VALUE="sharedQuery">
>
> 2)
> <INPUT TYPE="hidden" NAME="LastForm" VALUE="DumpBug">
> <INPUT TYPE="hidden" NAME="REMOTE_USER" VALUE="karim.liateni">
> <INPUT TYPE="text" NAME="bug_id" VALUE="" SIZE=10 MAXLENGTH=10>
> <INPUT TYPE="submit" NAME=".submit" VALUE="View">
>
> And I recall my data of the progam below:
>
> data = {
> 'init' : "",
> 'LastForm': "SavedQuery",
> 'prompted': "yes",
> 'class': "Development",
> 'personalQuery': "DKPV",
> 'REMOTE_USER': username,
> 'QS': " -p DKPVALIDATION_PLUGIN \(Class 'isequal'
> "Development" \)",
> 'use_field_defs':"false",
> 'QueryName': "DKPV",
> 'QueryType': "personal",
> 'ACTION': "Query"
> }
>
> So the question is how could I specify the correct FORM submission and
> how could I chose the correct action because
> there are several TYPE='submit' and I am only interested by this one
> VALUE="Query"?
>
> Regards
> Karim
>
> On 02/11/2011 08:51 AM, Karim wrote:
>>
>> Hello,
>>
>> In fact as found in the net:
>>
>> "The concept of browser frames is completely outside the scope of
>> HTTP. However, browser frames are defined in HTML, and so is the
>> target property on form elements: <form action="/somescript?x=y"
>> method="POST" target="_top"> This will make the form submit to the
>> _top frame, which means "use the full browser window" "
>>
>> That means that my post form:
>>
>> <FORM METHOD="POST" ACTION="/ddts/ddts_main"
>> ENCTYPE="application/x-www-form-urlencoded" TARGET="rightframe">
>>
>> has a target property to make the submit to the 'rightframe'.
>>
>> Any ideas how I can modified the code (I think the request data or
>> whatever) below to access without knowing the temporary html file
>> name generically.
>>
>> Regards
>> Karim
>>
>> On 02/10/2011 07:12 PM, Karim wrote:
>>>
>>> Hello All,
>>>
>>> I get from Steven an very useful link (void space) for http
>>> authentication. I added some codes to be
>>> able to POST FORM a query as I do it by clicking a query button to
>>> get a list of bug Id on a server.
>>> The problem is I get a html page which refers 2 frames. And I am
>>> interesting in one particular frame
>>> namely for example,
>>> http://{server}:{port}/wt/tmp/results:karim.liateni.31_3917.html'.format(server=server,
>>> port=port).
>>> But this pages is created every times in a tmp directory each time
>>> with a different name.
>>>
>>> 1) How can I get the name of this page because with python the page
>>> resulting of my query is not mentionned (hidden like)?
>>> Interactively there are 3 frames but only this one is of interest
>>> for me. But no name of this page is visible in the main html page.
>>> Is there a method to get all the nested frames locations?
>>>
>>> 2) I can see this page interactively when I click on a submit query
>>> button. Do I need to add 'ACTION': "Query" <input form
>>> in the query dictionnary to simulate a click for submission
>>> (type="submit" button) ?
>>>
>>> 3) Interactively I see that cgi arg NextForm is empty so I let it
>>> like that in my query and LastForm was set to "SavedQuery". I put the
>>> same value in my python code. Is this ok?
>>>
>>> import urllib
>>> import urllib2
>>>
>>> server='dummy.com'
>>> port='8081'
>>>
>>> username = 'karim.liateni'
>>> password = 'dummy_pass'
>>>
>>> theurl =
>>> 'http://{server}:{port}/ddts/ddts_main'.format(server=server,
>>> port=port)
>>> #theurl =
>>> 'http://{server}:{port}:8081/wt/tmp/results:karim.liateni.31_3917.html'.format(server=server,
>>> port=port)
>>>
>>> #MEMO:
>>> #<FORM METHOD="POST" ACTION="/ddts/ddts_main"
>>> ENCTYPE="application/x-www-form-urlencoded" TARGET="rightframe">
>>>
>>> data = {
>>> 'NextForm': "",
>>> 'LastForm': "SavedQuery",
>>> 'prompted': "yes",
>>> 'class': "Development",
>>> 'personalQuery': "DKPV",
>>> 'REMOTE_USER': username,
>>> 'QS': " -p DKPVALIDATION_PLUGIN \(Class 'isequal'
>>> "Development" \)",
>>> 'use_field_defs':"false",
>>> 'QueryName': "DKPV",
>>> 'QueryType': "personal",
>>> 'ACTION': "Query"
>>> }
>>>
>>> query = urllib.urlencode(data)
>>> request = urllib2.Request(theurl, query)
>>>
>>> passman = urllib2.HTTPPasswordMgrWithDefaultRealm()
>>> passman.add_password(None, theurl, username, password)
>>> authhandler = urllib2.HTTPBasicAuthHandler(passman)
>>>
>>> opener = urllib2.build_opener(authhandler)
>>> urllib2.install_opener(opener)
>>>
>>> pagehandle = urllib2.urlopen(request)
>>> print(pagehandle.read())
>>> _______________________________________________
>>> Tutor maillist - Tutor at python.org
>>> To unsubscribe or change subscription options:
>>> http://mail.python.org/mailman/listinfo/tutor
>>
>> _______________________________________________
>> Tutor maillist - Tutor at python.org
>> To unsubscribe or change subscription options:
>> http://mail.python.org/mailman/listinfo/tutor
>
>
The solution to handle multiple post forms in a same web page and to
submit a given one programmatically is
to use this very must have module ClientForm from
"http://wwwsearch.sourceforge.net/ClientForm" and maintained by John J.Lee
Example from this module:
response =
urllib2.urlopen("http://wwwsearch.sourceforge.net/ClientForm/example.html")
forms = ClientForm.ParseResponse(response, backwards_compat=False)
form = forms[0]
print form
# set html widget value
form["comments"] = "Thanks, Gisle"
#Controls are html widgets (Listbox, checkbutton, combobox, etc ...)
print "parmesan" in [item.name for item in
form.find_control("cheeses").items if item.selected]
# select item labelled "Mozzarella" in control with id "chz" as the same
with a mouse-click:
form.find_control(id="chz").get(label="Mozzarella").selected = True
# submit the form returns a urllib2.Request object
new_request = form.click()
new_response = urllib2.urlopen(new_request)
This is a very handy and easy module!
For whom it mays concern.
Regards
Karim
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-list/attachments/20110216/d0ebc5f2/attachment-0001.html>
More information about the Python-list
mailing list