slow loop?

Brian Kranson bk at whack.org
Mon Jan 13 11:42:34 EST 2003


Is there a way I can make this small script any faster?  The file it
reads in used to be only about a 100 lines and now it is well over
2000.  It takes about 14 seconds to run it on my PentiumII.  Thanks in
advance - Bk

import time
startTime=time.time()
myList=[]
finalList=[]
myString=''
file=open('Export.txt','r')
lines=file.readlines()
for line in lines:
        for character in line:
                if character == '"':
                        None
                elif character == ',' or character == '\n':
                        myList.append(myString)
                        myString=''
                else:
                        myString += character
        finalList.append(myList)
        myList=[]
endTime=time.time()
print endTime-startTime


Here are two lines from Export.txt (the first line ends with "NONE" -
google and/or your browser might add some extra end of line
characthers - this sample Export.txt should only have two lines)

"IDNUMBER","VRNUMBER","LASTNAME","FIRSTNAME","MAILNAME","SALUTATION","ADDRESS1","ADDRESS2","ADDRESS3","CITY","STATE","ZIP","COUNTY","CONGRESS","SENATEDIST","HOUSEDIST","RECSTATUS","REGISTER","CARRT","HPHONE","WPHONE","FPHONE","APHONE","EMPLOYER","OCCUPATION","BIRTHDATE","CONSTITUENTTYPE","ORIGIN","AFFILIATION","SEX","PRECINCT","HOMESOUND","UPDATEDATE","FAMILY","CONTEXIST","EXPEXIST","VOTEEXIST","N
TEEXIST","VOLEXIST","VIPEXIST","CASEEXIST","REMIND","BILLEXIST","WFAX_PHONE","CAR_PHONE","E_MAIL","PAGER","MAIL_WHERE","CONTACT","AWARD_TYPE","AWARD_DATE","ELIGIBLE","JOIN_DATE","PAY_GRP","PAY_AMOUNT","WADDRESS1","WADDRESS2","WADDRESS3","WCITY","WSTATE","WZIP","WCARRT","MADDRESS1","MADDRESS2","MADDRESS3","MCITY","MSTATE","MZIP","MCARRT","DADDRESS1","DADDRESS2","DADDRESS3","DCITY","DSTATE","DZIP","
CARRT","HOUSEHOLDMAILNAME","HOUSEHOLDSALUTATION","TOTALCONTRIBUTIONS","LARGESTCONTRIBUTION","AVERAGECONTRIBUTION","LASTCONTRIBUTION","LASTCONTRIBUTIONDATE","YEAR1TOTAL","YEAR2TOTAL","CONTRIBUTIONSYEAR1","CONTRIBUTIONSYEAR2","NONE"
"63","","Last","First","Ms. First L. Last","Sal","220 Street
Blvd.","","","Oregon","OH","43616","Lucas","9","","","1","  /  /   
","","","","","","","","12/30/1899","Individual","","","Female","","HOME","07/13/1999","","Y","","","","","","","","","","","","","H","","","
 /  /    ","","  /  /    ","","0","220 Street
Blvd.","","","Oregon","OH","43616","","220 Street
Blvd.","","","Oregon","OH","43616","","220 Street
Blvd.","","","Oregon","OH","43616-","","Ms. Frist L.
Last","First","25.00","25.00","25.00","25.00","01/06/1999","0.00","0.00","0","0","none"




More information about the Python-list mailing list