[SciPy-User] Identify unique sequence data from array

otrov dejan.org@gmail....
Wed Dec 22 14:18:03 CST 2010


>> The problem:

>> I have 2D data sets (scipy/numpy arrays) of 10^7 to 10^8 rows, which consists of repeated sequences of one unique sequence, usually ~10^5 rows, but may differ in scale. Period is same for both columns, so there is not really difference if we consider 2D or 1D array.
>> I want to track this data block.

> for i in range(1, len(X)-1):
>     if (X[i:] == X[:-i]).all():
>         break

Just look at that python beauty! Such a great language when in hand of a smart user.
Thanks for you snippet, but unfortunately it takes forever to finish the task



More information about the SciPy-User mailing list