NumPy/SciPy + MPI for Python

Brian Granger ellisonbg.net at gmail.com
Fri Oct 13 17:49:41 CDT 2006


Just as a data point.

I have used mpi4py before and have built it on many systems ranging
from my macbook to NERSC supercomputers.  In my opinion it is
currently the best python mpi bindings available.  Lisandro has done a
fantastic job with this.  Also Fernando and I have worked hard to make
sure that mpi4py works with the new parallel capabilities of IPython.

I would love to see mpi4py hosted in a public repository for others to
contribute.  I think this would really solidify mpi4py as a top notch
mpi interface.  But, my only concern is that there might be many folks
who want to use mpi4py who don't need scipy.  I am one of those folks
- I don't necessarily need scipy on the NERSC supercomputers, but I do
need mpi4py.  Because of this, I would probably still recommend
keeping mpi4py as a separate project.  Is there any chance it could be
hosted at mip4py.scipy.org?

I strongly encourage others to try it out.  Installation is is easy.

Brian Granger

On 10/13/06, Lisandro Dalcin <dalcinl at gmail.com> wrote:
> This post is surely OT, but I cannot imagine a better place to contact
> people about this subject. Please, don't blame me.
>
> Any people here interested in NumPy/SciPy + MPI? From some time ago,
> I've been developing mpi4py (first release at SF) and I am really near
> to release a new version.
>
> This package exposes an API almost identical to MPI-2 C++ bindings.
> Almost all MPI-1 and MPI-2 features (even one-sided communications and
> parallel I/O) are fully supported for any object exposing
> single-segment buffer interface, an only some of them for
> communication of general Python objects (with the help of
> pickle/marshal).
>
> The posibility of constructing any user-defined MPI datatypes, as well
> as virtual topologies (specially cartesian), can be really nice for
> anyone interested in parallel multidimensional array procesing.
>
> Before the next release, I would like to wait for any comment, You can
> contact me via private mail to get a tarbal with latest developments,
> or we can have some discussion here, if many of you consider this a
> good idea. In the long term, I would like to see mpi4py integrated as
> a subpackage of SciPy.
>
> Regards,
>
> --
> Lisandro Dalcín
> ---------------
> Centro Internacional de Métodos Computacionales en Ingeniería (CIMEC)
> Instituto de Desarrollo Tecnológico para la Industria Química (INTEC)
> Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET)
> PTLC - Güemes 3450, (3000) Santa Fe, Argentina
> Tel/Fax: +54-(0)342-451.1594
> _______________________________________________
> Scipy-dev mailing list
> Scipy-dev at scipy.org
> http://projects.scipy.org/mailman/listinfo/scipy-dev
>




More information about the Numpy-discussion mailing list