[SciPy-User] Identify unique sequence data from array
Wed Dec 22 14:18:03 CST 2010
>> The problem:
>> I have 2D data sets (scipy/numpy arrays) of 10^7 to 10^8 rows, which consists of repeated sequences of one unique sequence, usually ~10^5 rows, but may differ in scale. Period is same for both columns, so there is not really difference if we consider 2D or 1D array.
>> I want to track this data block.
> for i in range(1, len(X)-1):
> if (X[i:] == X[:-i]).all():
Just look at that python beauty! Such a great language when in hand of a smart user.
Thanks for you snippet, but unfortunately it takes forever to finish the task
More information about the SciPy-User