[Numpy-discussion] fromstring, tostring slow?

[Stefan van der Walt]

On Tue, Feb 13, 2007 at 03:44:37PM -0800, Mark Janikas wrote:
> I don't think I can do that because I have heterogeneous rows of
> data.... I.e. the columns in each row are different in length.
> Furthermore, when reading it back in, I want to read only bytes of the
> info at a time so I can save memory.  In this case, I only want to have
> one record in mem at once.
> 
> Another issue has arisen from taking this routine cross-platform....
> namely, if I write the file on Windows I cant read it on Solaris.  I
> assume the big-little endian is at hand here.

Indeed.  You may want to take a look at npfile, the new IO module in
scipy written by Matthew Brett (you don't have to install the whole
scipy to use it, just grab the file).

Cheers
Stéfan