[Numpy-discussion] Question about improving genfromtxt errors

[Christopher Barker]

Skipper Seabold wrote:
> FWIW, I have a script that creates and savez arrays from several text
> files in total about 1.5 GB of text.
> 
> without the incrementing in genfromtxt
> 
> Run time: 122.043943 seconds
> 
> with the incrementing in genfromtxt
> 
> Run time: 131.698873 seconds
> 
> If we just want to always keep track of things, I would be willing to
> take a poorly measured 8 % slowdown,

I also think 8% is worth it, but I'm still surprised it's that much. 
What addition code is inside the inner loop? (or , I guess, the each 
line loop...)

-Chris



-- 
Christopher Barker, Ph.D.
Oceanographer

Emergency Response Division
NOAA/NOS/OR&R            (206) 526-6959   voice
7600 Sand Point Way NE   (206) 526-6329   fax
Seattle, WA  98115       (206) 526-6317   main reception

Chris.Barker at noaa.gov