[SciPy-dev] code for incremental least squares
Tue Feb 16 14:37:55 CST 2010
2010/2/16 Stéfan van der Walt <email@example.com>:
> Hi Nathan
> On 16 February 2010 22:18, Nathaniel Smith <firstname.lastname@example.org> wrote:
>> I have a need for solving some very large least squares regression
>> problems -- but fortunately my model matrix can be generated
>> incrementally, so there are some tricks to do the important
>> calculations without actually loading the whole thing into memory. The
>> resulting code is rather general, and might be of wider interest, so I
>> thought I'd send a note here and see what people thought about
>> upstreaming it somehow...
> This sounds interesting! Could you expand on the incremental
> generation of the model matrix, and how it is made general?
I have the same thought, Are you increasing by observation or by
For either case, I would be very interested to see this kind of
incremental least squares in statsmodels. If you are able to license
your parts as BSD, then I will look at it for sure.
We have some plans for this but not yet implemented.
> SciPy-Dev mailing list
More information about the SciPy-Dev