[Numpy-discussion] "import numpy" is slow

Nathan Bell wnbell@gmail....
Thu Jul 31 07:46:20 CDT 2008

On Thu, Jul 31, 2008 at 7:31 AM, Hanni Ali <hanni.ali@gmail.com> wrote:
> I would just to highlight an alternate use of numpy to interactive use. We
> have a cluster of machines which process tasks on an individual basis where
> a master tasks may spawn 600 slave tasks to be processed. These tasks are
> spread across the cluster and processed as scripts in a individual python
> thread. Although reducing the process time by 300 seconds for the master
> task is only about a 1.5% speedup (total time can be i excess of 24000s). We
> process large number of these tasks in any given year and every little
> helps!

There are other components of NumPy/SciPy that are more worthy of
optimization.  Given that programmer time is a scarce resource, it's
more sensible to direct our efforts towards making the other 98.5% of
the computation faster.

/law of diminishing returns

Nathan Bell wnbell@gmail.com

More information about the Numpy-discussion mailing list