Différences

Ci-dessous, les différences entre deux révisions de la page.

Lien vers cette vue comparative

Les deux révisions précédentes Révision précédente
Prochaine révision
Révision précédente
deeplearning:dellvolta100:jupyter [2020/03/11 10:04] – [Start Jupyter Notebook] admindeeplearning:dellvolta100:jupyter [2020/03/11 10:31] (Version actuelle) – [Submit SGE Job] admin
Ligne 8: Ligne 8:
 ====== Submit SGE Job ====== ====== Submit SGE Job ======
  
-Request one GPU and 40Gb of memory for example:+Request one GPU and 40Gb of memory for 4 hours :
 <code bash> <code bash>
  
-$ qlogin -q volta.q -l h_vmem=40G+$ qlogin -q volta.q -l h_vmem=40G -l h_rt=4:00:00
  
 </code> </code>
Ligne 44: Ligne 44:
   * ''--no-browser''  do not start the browser automatically    * ''--no-browser''  do not start the browser automatically 
   * ''--ip=0.0.0.0'' the server will listen on all interfaces.   * ''--ip=0.0.0.0'' the server will listen on all interfaces.
 +  * The system will pick a random port number to use. 
 +
 +
 +====== Connect to the notebook  ======
 +
 +If all goes well we see this message with important information
 +
 +<code bash>
 +[I 11:04:54.299 NotebookApp] JupyterLab extension loaded from /opt/anaconda3/lib/python3.7/site-packages/jupyterlab
 +[I 11:04:54.299 NotebookApp] JupyterLab application directory is /opt/anaconda3/share/jupyter/lab
 +[I 11:04:54.300 NotebookApp] Serving notebooks from local directory: /Work/Users/kmazouzi
 +[I 11:04:54.300 NotebookApp] The Jupyter Notebook is running at:
 +[I 11:04:54.301 NotebookApp] http://(node2-69 or 127.0.0.1):8888/?token=07f2f688b651f329387c7b1459389edc7d1f37da60c90d65
 +[I 11:04:54.301 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
 +[C 11:04:54.307 NotebookApp] 
 +    
 +    To access the notebook, open this file in a browser:
 +        file:///Work/Users/kmazouzi/.local/share/jupyter/runtime/nbserver-2683-open.html
 +    Or copy and paste one of these URLs:
 +        http://(node2-69 or 127.0.0.1):8888/?token=07f2f688b651f329387c7b1459389edc7d1f37da60c90d65
 +
 +</code>
 +
 +There are three important pieces of information, above, to remember:
 +  * The node used by SGE, here **node2-69**
 +  * The port picked by Jupyter-nootbook, here **8888**
 +  * The token of the session, here ''token=07f2f688b651f329387c7b1459389edc7d1f37da60c90d65''
 +
 +<note important>We can't connect directly to the link above because node2-69 is located in private network.
 +We have to use ssh port tunneling. </note> 
 +
 +===== SSH tunnel =====
 +We need to establish a tunnel from ''mesoshared'' to this volta node. 
 +Here is the command to use from ''mesoshared'' terminal:
 +<code bash>
 +$ ssh -g  -N -L 9999:localhost:8888 kmazouzi@node2-69
 +</code>
 +
 +This command will map remote port ''8888'' from ''node2-69'' to ''local'' port ''9999'' in ''mesoshared'' (localhost).
 +Finally we will modify the URL above to connect to our Jupyter session.
 +
 +OLD URL proposed by Jupyter:
 +  * http://node2-69:8888/?token=07f2f688b651f329387c7b1459389edc7d1f37da60c90d65
 +
 +The new URL to use, from your browser:
 +  * http://mesoshared.univ-fcomte.fr:9999/?token=07f2f688b651f329387c7b1459389edc7d1f37da60c90d65
  
  
  • deeplearning/dellvolta100/jupyter.1583921072.txt.gz
  • Dernière modification : 2020/03/11 10:04
  • de admin