Ah, I take that back, I see that the command "ipcluster start -n 5 --profile=sge" dumps more informative message to my home directory, for instance the attached files, which are copied below. I am looking into this.<br>
<br>ipcontroller error<div><br></div><div><div> -sh: module: line 1: syntax error: unexpected end of file</div><div> -sh: error importing function definition for `module'</div><div> /usr/share/gridengine/hpc/spool/cloudcompute-6/job_scripts/2093: line 5: syntax error near unexpected token `--log-to-file'</div>
<div> /usr/share/gridengine/hpc/spool/cloudcompute-6/job_scripts/2093: line 5: `/software/linux/x86_64/epd-7.3-1/bin/python -c from IPython.parallel.apps.ipcontrollerapp import launch_new_instance; launch_new_instance() --log-to-file --profile-dir="/home/robert/.ipython/profile_sge" --cluster-id=""'</div>
<div><br></div><div>ipengine error</div><div><br></div><div><div> -sh: module: line 1: syntax error: unexpected end of file</div><div> -sh: error importing function definition for `module'</div><div> /usr/share/gridengine/hpc/spool/cloudcompute-7/job_scripts/2094: line 5: syntax error near unexpected token `--profile-dir="/home/robert/.ipython/profile_sge"'</div>
<div> /usr/share/gridengine/hpc/spool/cloudcompute-7/job_scripts/2094: line 5: `/software/linux/x86_64/epd-7.3-1/bin/python -c from IPython.parallel.apps.ipengineapp import launch_new_instance; launch_new_instance() --profile-dir="/home/robert/.ipython/profile_sge" --cluster-id=""'</div>
</div><br><div class="gmail_quote">On Wed, Jul 11, 2012 at 12:09 PM, Robert Nishihara <span dir="ltr"><<a href="mailto:robertnishihara@gmail.com" target="_blank">robertnishihara@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
There was no stdout, and the stderr (attached and copied below) looks normal.<div><br></div><div><div>I started the controller and engines separately this time (with qsub), using the two attached scripts. This procedure worked fine before the upgrade.</div>
<div><br></div><div>I tried recreating the sge profile using the instructions from this thread <<a href="http://python.6.n6.nabble.com/Getting-setup-on-a-remote-cluster-w-Sun-Grid-Engine-td1663090.html" target="_blank">http://python.6.n6.nabble.com/Getting-setup-on-a-remote-cluster-w-Sun-Grid-Engine-td1663090.html</a>>, and this had no effect.</div>
</div><div><br></div><div>stderr for controller</div><div><br></div><div><div> 2012-07-11 14:59:49,674.674 [IPControllerApp] Using existing profile dir: u'/home/robert/.ipython/profile_sge'</div><div> 2012-07-11 14:59:49.797 [IPControllerApp] Hub listening on tcp://<a href="http://0.0.0.0:52512" target="_blank">0.0.0.0:52512</a> for registration.</div>
<div> 2012-07-11 14:59:49.799 [IPControllerApp] Hub using DB backend: 'NoDB'</div><div> 2012-07-11 14:59:50.079 [IPControllerApp] hub::created hub</div><div> 2012-07-11 14:59:50.085 [IPControllerApp] writing connection info to /home/robert/.ipython/profile_sge/security/ipcontroller-client.json</div>
<div> 2012-07-11 14:59:50.103 [IPControllerApp] writing connection info to /home/robert/.ipython/profile_sge/security/ipcontroller-engine.json</div><div> 2012-07-11 14:59:50.129 [IPControllerApp] task::using Python leastload Task scheduler</div>
<div> 2012-07-11 14:59:50.135 [IPControllerApp] Heartmonitor started</div><div> 2012-07-11 14:59:50.166 [scheduler] Scheduler started [leastload]</div><div> 2012-07-11 14:59:50.195 [IPControllerApp] Creating pid file: /home/robert/.ipython/profile_sge/pid/ipcontroller.pid</div>
<div><br></div><div>stderr for engines</div><div><br></div><div><div> 2012-07-11 14:59:58,438.438 [IPClusterEngines] Using existing profile dir: u'/home/robert/.ipython/profile_sge'</div><div> 2012-07-11 14:59:58.470 [IPClusterEngines] IPython cluster: started</div>
<div> 2012-07-11 14:59:58.471 [IPClusterEngines] Starting engines with [daemon=False]</div><div> 2012-07-11 14:59:58.471 [IPClusterEngines] Starting 5 Engines with SGEEngineSetLauncher</div><div> 2012-07-11 14:59:58.559 [IPClusterEngines] Job submitted with job id: '2092'</div>
<div> 2012-07-11 15:00:28.559 [IPClusterEngines] Engines appear to have started successfully</div></div><span class="HOEnZb"><font color="#888888"><div><br></div><div>-Robert</div></font></span><div><div class="h5"><br>
<div class="gmail_quote">On Wed, Jul 11, 2012 at 10:42 AM, MinRK <span dir="ltr"><<a href="mailto:benjaminrk@gmail.com" target="_blank">benjaminrk@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">What is the stdout/err of the controller and engine jobs?<br>
<div><div><br>
On Wed, Jul 11, 2012 at 6:03 PM, Robert Nishihara<br>
<<a href="mailto:robertnishihara@gmail.com" target="_blank">robertnishihara@gmail.com</a>> wrote:<br>
> My cluster recently upgraded to IPython 0.13. Now, when I run<br>
><br>
> ipcluster start -n 3 --profile=sge<br>
><br>
> the controller and engines get submitted to the queue, but the terminate<br>
> immediately after starting. However, the output looks normal<br>
><br>
> 2012-07-11 11:56:27,531.531 [IPClusterStart] Using existing profile dir:<br>
> u'/home/robert/.ipython/profile_sge'<br>
> 2012-07-11 11:56:27.566 [IPClusterStart] Starting ipcluster with<br>
> [daemon=False]<br>
> 2012-07-11 11:56:27.570 [IPClusterStart] Creating pid file:<br>
> /home/robert/.ipython/profile_sge/pid/ipcluster.pid<br>
> 2012-07-11 11:56:27.573 [IPClusterStart] Starting Controller with<br>
> SGEControllerLauncher<br>
> 2012-07-11 11:56:27.723 [IPClusterStart] Job submitted with job id:<br>
> '2088'<br>
> 2012-07-11 11:56:28.568 [IPClusterStart] Starting 3 Engines with<br>
> SGEEngineSetLauncher<br>
> 2012-07-11 11:56:28.645 [IPClusterStart] Job submitted with job id:<br>
> '2089'<br>
> 2012-07-11 11:56:58.647 [IPClusterStart] Engines appear to have started<br>
> successfully<br>
><br>
> Is there a good way to troubleshoot this? The --debug flag doesn't seem to<br>
> give me any useful information.<br>
><br>
> -Robert<br>
><br>
</div></div>> _______________________________________________<br>
> IPython-User mailing list<br>
> <a href="mailto:IPython-User@scipy.org" target="_blank">IPython-User@scipy.org</a><br>
> <a href="http://mail.scipy.org/mailman/listinfo/ipython-user" target="_blank">http://mail.scipy.org/mailman/listinfo/ipython-user</a><br>
><br>
_______________________________________________<br>
IPython-User mailing list<br>
<a href="mailto:IPython-User@scipy.org" target="_blank">IPython-User@scipy.org</a><br>
<a href="http://mail.scipy.org/mailman/listinfo/ipython-user" target="_blank">http://mail.scipy.org/mailman/listinfo/ipython-user</a><br>
</blockquote></div><br></div></div></div>
</blockquote></div><br></div>