How can I export data from a website and write the contents to a text file?

[ryguy7272]

On Wednesday, November 18, 2015 at 12:04:16 PM UTC-5, ryguy7272 wrote:
> On Wednesday, November 18, 2015 at 11:58:17 AM UTC-5, Chris Angelico wrote:
> > On Thu, Nov 19, 2015 at 3:37 AM, ryguy7272 <> wrote:
> > >       text_file = open("C:/Users/rshuell001/Desktop/excel/Text1.txt", "wb")
> > >         z = str(link)
> > >         text_file.write(z + "\n")
> > >         text_file.write("\n")
> > >         text_file.close()
> > 
> > You're opening the file every time you go through the loop,
> > overwriting each time. Instead, open the file once, then start the
> > loop, and then close it at the end. You can use a 'with' statement to
> > do the closing for you, or you can do it the way you are here.
> > 
> > ChrisA
> 
> 
> 
> Thanks.  What would the code look like?  I tried the code below, and got the same results.
> 
> 
> for item in soup.find_all(class_='lister-list'):
>     for link in item.find_all('a'):
>         #print(link)
>         z = str(link)
>         text_file = open("C:/Users/rshuell001/Desktop/excel/Text1.txt", "wb")
>         text_file.write(z + "\n")
>         text_file.close()


Oh, I see, it's like this:

text_file = open("C:/Users/rshuell001/Desktop/excel/Text1.txt", "wb")
var_file.close()
soup = BeautifulSoup(var_html)
for item in soup.find_all(class_='lister-list'):
    for link in item.find_all('a'):
        #print(link)
        z = str(link)
        text_file.write(z + "\n")
text_file.close()


However, it's not organized very well, and it's hard to read.  I thought the '\n' would create a new line after one line was written.  Now, it seems like everything is jumbled together.  Kind of weird.  Am I missing something?