Delete duplicate rows in textfile - except it contains a "{" or "}"

Joon Ki Choi joon.ch at gmail.com
Wed Oct 10 09:51:54 EDT 2012


lines_seen = set() # holds lines already seen
outfile = open("literatur_clean.txt", "w")
for line in open("literatur_dupl.txt", "r"):
    if ('{' in line or '}' in line) or line not in lines_seen:
        outfile.write(line)
        lines_seen.add(line)
outfile.close()



More information about the Python-list mailing list