[Numpy-discussion] setting decimal accuracy in array operations (scikits.timeseries)
Wed Mar 3 15:06:48 CST 2010
Robert Kern wrote:
> On Wed, Mar 3, 2010 at 14:09, Marco Tuckner
>> In Python the numbers show:
>> whereas in Excel I see:
> If you are still seeing actual calculation differences, we will need
> to see a complete, self-contained example that demonstrates the
To add a bit more detail -- unless you are explicitly specifying single
precision floats (dtype=float32), then both numpy and excel are using
doubles -- so that's not the source of the differences. Even if you are
using single precision in numpy, It's pretty rare for that to make a
significant difference. Something else is going on.
I suspect a different algorithm, you can tell timeseries.convert how you
want it to interpolate -- who knows what excel is doing.
Christopher Barker, Ph.D.
Emergency Response Division
NOAA/NOS/OR&R (206) 526-6959 voice
7600 Sand Point Way NE (206) 526-6329 fax
Seattle, WA 98115 (206) 526-6317 main reception
More information about the NumPy-Discussion