This article will guide you to run a Python script using Slurm script on a LANTA HPC system.
Slurm script example for running a Python script
Running on Compute node
| Code Block |
|---|
#!/bin/bash
#SBATCH -p compute # Specify partition [Compute/Memory/GPU]
#SBATCH -N 1 –c 128 # Specify number of nodes and processors per task
#SBATCH --ntasks-per-node=1 # Specify tasks per node
#SBATCH -t 120:00:00 # Specify maximum time limit (hour: minute: second)
#SBATCH -A ltxxxxxx # Specify project name
#SBATCH -J JOBNAME # Specify job name
module purge # Unload all modules
module load Miniconda3/22.11.1-1 # Load the Miniconda3 module
conda activate tensorflow-2.6.0 # Activate your environment
python3 file.py # Run your program or executable code |
...
| Code Block |
|---|
#!/bin/bash
#SBATCH -p gpu # Specify partition [Compute/Memory/GPU]
#SBATCH -N 1 –c 16 # Specify number of nodes and processors per task
#SBATCH --gpus-per-task=1 # Specify number of GPU per task
#SBATCH --ntasks-per-node=4 # Specify tasks per node
#SBATCH -t 120:00:00 # Specify maximum time limit (hour: minute: second)
#SBATCH -A ltxxxxxx # Specify project name
#SBATCH -J JOBNAME # Specify job name
module purge # Unload all modules
module load Miniconda3/22.11.1-1 # Load the Miniconda3 module
conda activate tensorflow-2.6.0 # Activate your environment
python3 file.py # Run your program or executable code |
Submit a job
Use the sbatch script.sh commands to submit your job to the Slurm system.
| Code Block |
|---|
username@lanta:~> sbatch script.sh |
...
Related articles
| Filter by label (Content by label) |
|---|
| showLabels | false |
|---|
| max | 5 |
|---|
| spaces | com.atlassian.confluence.content.render.xhtml.model.resource.identifiers.SpaceResourceIdentifier@48ae393 |
|---|
| sort | modified |
|---|
| showSpace | false |
|---|
| reverse | true |
|---|
| type | page |
|---|
| cql | label = in ( "jupyter" , "env" ) and space = currentSpace ( ) |
|---|
| labels | singularity python container |
|---|
|
...