[Numpy-discussion] error with large memmap

David Cournapeau david@ar.media.kyoto-u.ac...
Tue Jun 9 04:52:08 CDT 2009


Charles R Harris wrote:
>
>
> On Tue, Jun 9, 2009 at 2:32 AM, John Schulman <joschu@caltech.edu
> <mailto:joschu@caltech.edu>> wrote:
>
>     I'm getting the error
>     OverflowError: cannot fit 'long' into an index-sized integer
>     when I try to memmap a 6gb file
>
>     top of the stack trace is
>     mm = mmap.mmap(fid.fileno(), bytes, access=acc)
>     where bytes = 6528000000L
>
>     I thought that 64-bit systems with python>2.5 could memmap large
>     files. I'm running the latest EPD python distribution (4.2.30201),
>     which uses python 2.5.4 and numpy 1.2.1
>     Macbook Pro Core 2 Duo, OS X 10.5.6
>
>
> Is your python 64 bits? Try:
>
> file `which python`

This is even better:

python -c "import platform; print platform.machine()"

as mac os x can be confusing with fat binaries and all :)

David


More information about the Numpy-discussion mailing list