[Numpy-discussion] np.loadtxt : yet a new implementation...
Tue Dec 2 09:24:16 CST 2008
On Mon, Dec 1, 2008 at 4:55 PM, Pierre GM <email@example.com> wrote:
> On Dec 1, 2008, at 4:47 PM, Stéfan van der Walt wrote:
> > I haven't investigated the code in too much detail, but wouldn't it be
> > possible to implement the current set of functionality in a
> > base-class, which is then specialised to add the rest? That way, one
> > could always instantiate TextReader yourself for some added speed.
> Well, one of the issues is that we need to keep the function
> compatible w/ urllib.urlretrieve (Ryan, am I right?), which means not
> being able to go back to the beginning of a file (no call to .seek).
Well, the original version of loadtxt() checked for seek but didn't need it
(fixed now), which kept me from using a urllib2.urlopen() object. If
actually using seek() would speed up the new version of loadtxt(), feel free
to use it. I'm more than capable of wrapping the urlopen() object within a
StringIO. However, I am unconvinced that removing the 2nd loop and instead
redoing the reading from the file will be much (if any) of a speed win.
Graduate Research Assistant
School of Meteorology
University of Oklahoma
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Numpy-discussion