Fast File Input

Eddie Corns eddie at holyrood.ed.ac.uk
Wed Feb 25 15:23:03 EST 2004


>"Scott Brady Drummonds" <scott.b.drummonds.nospam at intel.com> wrote in
>message news:c1iit0$2jj$1 at news01.intel.com...
>> Hi, everyone,
>>
>> I'm a relative novice to Python and am trying to reduce the processing
>time
>> for a very large text file that I am reading into my Python script.  I'm
>> currently reading each line one at a time (readline()), stripping the
>> leading and trailing whitespace (strip()) and splitting it's delimited
>data
>> (split()).  For my large input files, this text processing is taking many
>> hours.

If you mean delimited in the CSV sense then I believe that the CSV modules are
optimised for this.  Included in 2.3 IIRC.

Eddie




More information about the Python-list mailing list