[Numpy-discussion] searching binary data
Wed Sep 22 09:29:20 CDT 2010
On Wed, Sep 22, 2010 at 09:10, Neal Becker <email@example.com> wrote:
> A colleague of mine posed the following problem. He wants to search large
> files of binary data for sequences.
> I thought of using mmap (to avoid reading all data into memory at once) and
> then turning this into a numpy array (using buffer=).
> But, how to then efficiently find a sequence?
mmap objects have most of the usual string methods:
|2> f = open('./scratch/foo.py', 'r+b')
|4> m = mmap.mmap(f.fileno(), 0)
"I have come to believe that the whole world is an enigma, a harmless
enigma that is made terrible by our own mad attempt to interpret it as
though it had an underlying truth."
-- Umberto Eco
More information about the NumPy-Discussion