[Tutor] Using an XML file for web crawling

Igor Alexandre igorafm at gmail.com
Fri Mar 31 07:23:40 EDT 2017


Hi!
I'm a newbie in the Python/Web crawling world. I've been trying to find an answer to the following question since last week, but I couldn't so far, so I decided to ask it myself here: I have a sitemap in XML and I want to use it to save as text the various pages of the site. Do you guys know how can I do it? I'm looking for some code on the web where I can just type the xml address and wait for the crawler to do it's job, saving all the pages indicated in the sitemap as a text file in my computer. 
Thank you!
Best,
Igor Alexandre




More information about the Tutor mailing list