Ceci est une ancienne révision du document !
Running Jupyter notebook with V100 and SGE
We can run Jupyter notebook on the Volta nodes using SGE and ssh tunneling. This is done in 3 steps:
- Submit SGE Job(login session)
- Start Jupyter notebook in the opened shell
- Establish
sshtunnel and connect to the notebook
Submit SGE Job
Request one GPU and 40Gb of memory for example:
$ qlogin -q volta.q -l h_vmem=40G
Start Jupyter Notebook
In the opened shell session, we need to start jupyter-notbook. We will use conda
to isolate a new environment, for example.
But first, as usual we need to modify HOME directory to WORK (because HOME is Read Only)
$ export HOME=$WORK
We load anaconda and conda:
$ module load anaconda
We create or connect to our isolated conda environment.
Suppose that we have already an environment (use conda env list to view your environment list):
$ conda activate /Work/Users/kmazouzi/conda/meso
Finlay we start jupyter-notebook inside:
<code bash>
$ (/Work/Users/kmazouzi/conda/meso) kmazouzi@node2-69:~$ jupyter-notebook –no-browser –ip=0.0.0.0
<code>