[Python-ideas] Specify number of items to allocate for array.array() constructor

Oleg Broytman phd at phdru.name
Wed Jul 20 22:58:48 CEST 2011


On Wed, Jul 20, 2011 at 10:48:23PM +0200, Sven Rahmann wrote:
> I'm thinking of suffix arrays (a text indexing data structure) for
> large texts, eg the human genome and its reverse complement (about 6
> billion characters from the alphabet ACGT).
> The suffix array is a long int array of the same size (8 bytes per
> number, so it occupies about 48 GB memory).

   I doubt array.array was designed to handle data of such size. Why not
to use bsddb or such?

Oleg.
-- 
     Oleg Broytman            http://phdru.name/            phd at phdru.name
           Programmers don't die, they just GOSUB without RETURN.



More information about the Python-ideas mailing list