[SciPy-User] scipy sparse limits

[Chris Weisiger]

On Mon, Mar 12, 2012 at 9:48 AM, Eric <efmgdj at yahoo.com> wrote:
> Hi,  I'm trying to use large 10^5x10^5 sparse
> matrices but seem to
> be running up against a scipy limit:
>
> n=10**5, x=sp.rand(n,n,.001) gets
> "ValueError: Trying to generate a random sparse matrix such
> as the product of dimensions is greater than
> 2147483647 - this is not supported on this machine"
>
> Does anyone know why limit is there and if I can avoid it?

log2(2147483648) = 31, so it sounds like you're running into a 32-bit
limitation somewhere. If you can, using 64-bit Python/Numpy/Scipy
would probably get you around this.

-Chris