[Tutor] find data in html file

Kent Johnson kent37 at tds.net
Fri Sep 30 16:32:41 CEST 2005


lmac wrote:
> It's not this simple. The whole thing is that i try to use ebay.de for fetching websites
> when i give an articlenumber. The downloading of the site for a specific article is no problem.
> But to get the data like price,bidders,shipment etc without the official eBayAPI is hard.
> Maybe anyone has a solution made ?
> 
> Thanks anyway. I tried the htmllib. This is a very good lib but i don't get it to work cos
> there is no <tag> thing for the data i want to get. This is for html-tags. And to store data
> in my own XML-files. (what i am goint to do when i get the data).

You can try BeautifulSoup which is designed for screen-scraping:
http://www.crummy.com/software/BeautifulSoup/

But looking at the source for an eBay page it looks challenging. I wonder why you don't use the eBay API to get the information you want? It seems to be free for up to 10,000 requests a month and there is a python package to access it.

Kent



More information about the Tutor mailing list