I have the same behavior. I simply upgraded ipython using macports from 0.10.0 to 0.10.1. Now, it starts X11 whenever I simply invoke `ipython' from the command line. No pylab needed at all. It adds considerably to startup time. If I activate 0.10.0 the old behavior is restored and X11 is not started. Regards, David