[SciPy-user] Reading laaaarge arrays

[Jose Luis Gomez Dans]

Hi! 
I have a list of essentially (x,y) data (two columns, 
in glorious ASCII), that I want to read into a scipy 
array. The most obvious thing to do is to use 
io.read_array(), but the files are quite large (up to 
0.5Gb), and thus, read_array is very slow.  
 
I remember someone mentioning this before, and 
suggesting a little function written in C, and usable 
from within scipy to do this efficiently, but I can't 
find it in the archives or in my mailbox. 
 
Can anyone suggest a way to do this? So far, I've 
been trying to read in a 72Mb file for 17 minutes 
with io.read_array(), and it's still going!!! 
 
Many thanks, 
Jose 

-- 
+++ GMX DSL Premiumtarife 3 Monate gratis* + WLAN-Router 0,- EUR* +++
Clevere DSL-Nutzer wechseln jetzt zu GMX: http://www.gmx.net/de/go/dsl