[Numpy-discussion] newbie question - large dataset

[Charles R Harris]

On 4/7/07, Steve Staneff <staneff at constructiondatares.com> wrote:
>
> Hi,
>
> I'm looking for a better solution to managing a very large calculation.
> Set A is composed of tuples a, each of the form a = [float, string]; set B
> is composed of tuples of similar structure (b = [float, string]).  For
> each possible combination of a and b I'm calculating c, of the form c =
> f(a,b) = [g(a[0], b[0]), h(a[1], b[1])] where g() and h() are non-trivial
> functions.


Are you computing with *all* combinations of elements in a and b? I can't
tell from your description. What do the functions g and h look like? What do
the inputs and outputs actually look like? PyTables might be a good way to
manage the data sets, which look like they could be stored as record arrays.

Chuck
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/numpy-discussion/attachments/20070407/82083e59/attachment.html>