[Tutor] Webbrowser's capabilities to do more than just open up a webpage

Alan Gauld alan.gauld at yahoo.co.uk
Mon Aug 31 19:57:42 EDT 2020


On 31/08/2020 19:08, Stephen M Smith wrote:
> I am having trouble with various websites detecting the usage of python,
> selenium and chrome and rejecting my request to make reservations
> automatically. I am not scraping or in any way violating information that
> anyone could or would consider private or proprietary. 

It sounds as if you are scraping. That means any kind of robotic
activity where you extract data by examining user interface
details rather than through a published API.

> experiment with combinations of what is suggested, but have not found the
> answer yet.

That's because it is deliberately made as difficult as possible
to dissuade programmers from automating access. Its a bit like
hacking, you try to bypass the security arrangements of a server
or in your case bypass the security arrangements of a web
site designer. So yes, it will be difficult.

> I am hoping someone out there more knowledgeable than me can point me in the
> right direction. I know i may be biting off a lot, but i am basically a
> python hobbyist and am enjoying the learning process.

The right direction is to find a published API and use that.
If there isn't one it means the web site designer doesn't
want you accessing it programmatically - perhaps because
their web infrastructure is not capable of processing high
transaction rates or because it is funded by advertising
which you don't see if using an automated access.

If you aren't seeing the adverts the advertisers stop placing
the ads and the site loses revenue.

So, are you sure that the web site owner is happy for you
to access the site programatically?
If so, contact them and they may assist you find a way in.

If not, desist or persist in the sure knowledge that you are doing
battle with the content provider, who will doubtless be monitoring
for attempted access and adding new security features if/when
they detect such access..

-- 
Alan G
Author of the Learn to Program web site
http://www.alan-g.me.uk/
http://www.amazon.com/author/alan_gauld
Follow my photo-blog on Flickr at:
http://www.flickr.com/photos/alangauldphotos




More information about the Tutor mailing list