This article will guide you to run the Jupyter Notebook via Miniconda on the LANTA HPC system, which requires ssh tunneling to the LANTA HPC. An overview of the content can be found in the table of contents below for immediate visualization of the interesting parts.

Creating an environment to run the Jupyter Notebook

Load Miniconda module

1. Use the ml av Miniconda command to see which version of Miniconda is available on the LANTA HPC system.

2. Use the ml Miniconda3/xx.xx.x command to load the Miniconda version that you want to use. If you don't specify a version, the default version (D) is loaded, which is Miniconda3/22.11.1-1.

username@lanta:~> ml av Miniconda
---------------------- /lustrefs/disk/modules/easybuild/modules/all -----------------------
   Miniconda3/22.11.1-1

Use "module spider" to find all possible modules and extensions.
Use "module keyword key1 key2 ..." to search for all possible modules matching any of the "keys".
username@lanta:~> ml Miniconda3/22.11.1-1

Create

...

the environment

1. Use the conda create -n myenv python=3.9 commands to create the conda environment with myenv name and a specific version of python.

2. Use the conda activate myenv to activate the myenv environment.

...

(myenv) username@lanta:~> conda install jupyter
...
(myenv) username@lanta:~> conda install -c anaconda tensorflow-gpu
...

Running Jupyter Notebook via ssh tunneling

Example of Slurm script for running Jupyter Notebook

...

2. Copy/Paste the following command into your local terminal for ssh tunneling to the LANTA HPC

ssh -L 8714:x1000c2s0b0n0:8714 username@lanta.nstda.or.th -i id_rsa

...

http://127.0.0.1:8714/?token=2923d6fab4ef109f30e63a77014e632eed3fd2a5fa561929

...

Related articles

...