[Numpy-discussion] newbie question - large dataset
Charles R Harris
Sat Apr 7 12:04:01 CDT 2007
On 4/7/07, Steve Staneff <firstname.lastname@example.org> wrote:
> I'm looking for a better solution to managing a very large calculation.
> Set A is composed of tuples a, each of the form a = [float, string]; set B
> is composed of tuples of similar structure (b = [float, string]). For
> each possible combination of a and b I'm calculating c, of the form c =
> f(a,b) = [g(a, b), h(a, b)] where g() and h() are non-trivial
Are you computing with *all* combinations of elements in a and b? I can't
tell from your description. What do the functions g and h look like? What do
the inputs and outputs actually look like? PyTables might be a good way to
manage the data sets, which look like they could be stored as record arrays.
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Numpy-discussion