best set of modules for web automation without javascript

News123 news123 at free.fr
Fri Feb 13 12:41:00 EST 2009


Hi Marco / Paul,

Thanks


I'll look into
mechanize,ClientForm and BeautifulSoup.

All three are now installed. I'll just have to play with them.


bye


N

News123 wrote:
> Hi Joel,
> 
> Thanks,
> This (the urllib2 methods you combined with cookielib) is what I am
> currently trying to do.
> 
> I would just like to retrieve all the field names and default values of
> a form. (Some forms are huge) and wondered thus whether there's already
> a python module parsing a html documents for forms , form fields and
> field vaules, returning an objcet. that could be modified and posted.
> 
> 
> bye
> 
> N
> 
> 
> 
> Joe Riopel wrote:
>> On Fri, Feb 13, 2009 at 9:04 AM, News123 <news123 at free.fr> wrote:
>>> Hi,
>>> I'd like to do some web automation with python 2.5
>>> - https:
>>> - a cookiejar
>>> - some forms to be filled in
>>> what is the best set of modules.
>> I have automated some testing of our product, using it's web UI with
>> Python with urllib2 and urrlib. I don't actually fill in the forms, I
>> just recreate the post and set the values of the post variables (so I
>> don't get any form validation).
>>
>> Check out:
>> urllib2.build_opener
>> urllib2.HTTPCookieProcessor
>> urllib2.Request



More information about the Python-list mailing list