python to enable javascript , tried selinium, ghost, pyQt4 already

Chris Angelico rosuav at gmail.com
Sat Jan 18 17:32:36 EST 2014


On Sun, Jan 19, 2014 at 8:40 AM, Denis McMahon <denismfmcmahon at gmail.com> wrote:
> On Sun, 19 Jan 2014 05:13:57 +1100, Chris Angelico wrote:
>
>> On Sat, Jan 18, 2014 at 10:54 PM, Jaiprakash Singh
>> <jaiprakash at wisepromo.com> wrote:
>>> hi,
>>>
>>>      can you please suggest me some method for  study so that i can
>>>      scrap a site having JavaScript behind it
>>>
>>>
>>>  i have tried selenium, ghost, pyQt4,  but it is slow and as a am
>>>  working with thread it sinks my ram memory very fast.
>>
>> Do you mean "scrape"? You're trying to retrieve the displayed contents
>> of a web page that uses JavaScript? If so, that's basically impossible
>> without actually executing the JS code, which means largely replicating
>> the web browser.
>
> Oh, you think he meant scrape? I thought he was trying to scrap (as in
> throw away / replace) an old javascript heavy website with something
> using python instead.

I thought so too at first, but since we had another recent case of
someone confusing the two words, and since "scrape" would make sense
in this context, I figured it'd be worth asking the question.

ChrisA



More information about the Python-list mailing list