Ceci est une ancienne révision du document !


Running Jupyter notebook with V100 and SGE

We can run Jupyter notebook on the Volta nodes using SGE and ssh tunneling. This is done in 3 steps:

  1. Submit SGE Job(login session)
  2. Start Jupyter notebook in the opened shell
  3. Establish ssh tunnel and connect to the notebook

Submit SGE Job

Request one GPU and 40Gb of memory for example:

$ qlogin -q volta.q -l h_vmem=40G

Start Jupyter Notebook

In the opened shell session, we need to start jupyter-notbook. We will use conda to isolate a new environment, for example.

But first, as usual we need to modify HOME directory to WORK (because HOME is Read Only)

$ export HOME=$WORK

We load anaconda and conda:

$ module load anaconda

We create or connect to our isolated conda environment. Suppose that we have already an environment (use conda env list to view your environment list):

$ conda activate /Work/Users/kmazouzi/conda/meso

Finlay we start jupyter-notebook inside: <code bash> $ (/Work/Users/kmazouzi/conda/meso) kmazouzi@node2-69:~$ jupyter-notebook –no-browser –ip=0.0.0.0 <code>

  • deeplearning/dellvolta100/jupyter.1583920917.txt.gz
  • Dernière modification : 2020/03/11 10:01
  • de admin