Versions Compared

Version Old Version 21 New Version Current
Changes made by

Yutthana Wongnongwa

Yutthana Wongnongwa

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This article will guide you to create the environment using Miniconda on a LANTA HPC system. An overview of the content can be found in the table of contents below for immediate visualization of the interesting parts.

Table of Contents

Using

...

Mamba on LANTA HPC

Load

...

Mamba module

  1. Use the ml av MinicondaMamba command to see which version of Miniconda Mamba is available on the LANTA HPC system.

  2. Use the ml Miniconda3Mamba/xx.xx.x command to load the Miniconda Mamba version that you want to use. If you don't specify a version, the default version (D) is loaded, which is Miniconda3Mamba/2223.11.10-10.

Code Block
username@lanta:~> ml av MinicondaMamba
---------------------- /lustrefs/disk/modules/easybuild/modules/all -----------------------
   Miniconda3Mamba/2223.11.1-10-0 (D)

Use "module spider" to find all possible modules and extensions.
Use "module keyword key1 key2 ..." to search for all possible modules matching any of the "keys".
username@lanta:~> ml Miniconda3Mamba/2223.11.10-1

...

0

Unload Mamba module

Use the

...

module unload Mamba command to unload the Mamba.

Code Block
username@lanta:~> condamodule env list
# conda unload Mamba

Use the module purge command to unload all currently loaded modules.

Code Block
username@lanta:~> module purge
Note

Before you use the module unload Mamba or module purge command, you must deactivate your environment with the conda deactivate command.

Activate your environment

  1. Use the conda env list command to view a list of your environments.

  2. If you want to activate your environment such as TensorFlow-2.6.0, you can use the conda activate tensorflow-2.12.1 command.

Code Block
username@lanta:~> conda env list
# conda environments:
#
base                     /lustrefs/disk/modules/easybuild/software/Miniconda3Mamba/2223.11.10-10
netcdf-py39              /lustrefs/disk/modules/easybuild/software/Miniconda3Mamba/2223.11.10-10/envs/netcdf-py39
pytorch-12.112.02            /lustrefs/disk/modules/easybuild/software/Miniconda3Mamba/2223.11.10-10/envs/pytorch-12.112.02
tensorflow-2.612.0 1        /lustrefs/disk/modules/easybuild/software/Miniconda3Mamba/2223.11.10-10/envs/tensorflow-2.612.01
username@lanta:~> conda activate tensorflow-2.612.01
(tensorflow-2.6.0) .12.1) username@lanta:~>

Deactivate your environment

Use the conda deactivate command to deactivate your environments.

Code Block
(tensorflow-2.12.1) username@lanta:~> conda deactivate
username@lanta:~>

Creating the environment in the user’s home

Create the environment

Use the conda create -n myenv commands to create the environment with myenv name.

Code Block
username@lanta:~> conda create -n myenvcreate -n myenv
Channels:
 - conda-forge
Platform: linux-64
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /your directory/envs/myenv

Proceed ([y]/n)? y
...

Create the environment with a specific version of the packages

Use the conda create -n myenv python=3.9 commands to create the myenv environment with a specific version of python.

Code Block
username@lanta:~> conda create -n myenv python=3.9
Channels:
 - conda-forge
Platform: linux-64
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /your directory/envs/myenv

  added / updated specs:
    - python=3.9


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    capython-certificates-20233.01.10 |9.19              h06a4308|h0755675_0_cpython        22.7 MB 120 KBconda-forge
    certifiwheel-20220.12.743.0               |   py39h06a4308_0  pyhd8ed1ab_1          15057 KB  conda-forge
    ------------------------------------------------------------
                 
                         Total:         270 KB  The following NEW packages will be INSTALLED: 
  _libgcc_mutex      pkgs/main/linux-64::_libgcc_mutex-0.1-main
  _openmp_mutex  Total:     pkgs/main/linux-64::_openmp_mutex-5.1-1_gnu   ca-certificates 22.8 MB

 pkgs/main/linux-64::ca-certificates-2023.01.10-h06a4308_0
  certifi  The following NEW packages will be INSTALLED:

  _libgcc_mutex      pkgsconda-forge/main/linux-64::certifi-2022.12.7-py39h06a4308_0_libgcc_mutex-0.1-conda_forge
  ld_impl_linux-64openmp_mutex      pkgsconda-forge/main/linux-64::ld_implopenmp_linuxmutex-644.5-2.38-h1181459_1_gnu
  bzip2 libffi             pkgs/mainconda-forge/linux-64::libffibzip2-31.40.28-h6a678d5hd590300_65
  libgccca-ngcertificates          pkgs/main/conda-forge/linux-64::libgccca-ngcertificates-112024.2.02-h1234567hbcca054_10
  libgompld_impl_linux-64            pkgs/mainconda-forge/linux-64::libgomp-11.ld_impl_linux-64-2.040-h1234567_1h41732ed_0
  libffi      libstdcxx-ng       pkgsconda-forge/main/linux-64::libstdcxx-ng-11libffi-3.4.2.0-h1234567h7f98852_1
 5
ncurses  libgcc-ng          pkgs/mainconda-forge/linux-64::ncurses-6.4-h6a678d5_0libgcc-ng-13.2.0-h807b86a_5
  openssllibgomp            pkgs/mainconda-forge/linux-64::openssllibgomp-113.12.1t0-h7f8727eh807b86a_05
  piplibnsl                pkgs/mainconda-forge/linux-64::piplibnsl-222.30.1-py39h06a4308hd590300_0
  pythonlibsqlite             pkgs/main/conda-forge/linux-64::pythonlibsqlite-3.945.162-h7a1cb2ah2797004_0
  libuuid readline           pkgs/mainconda-forge/linux-64::readlinelibuuid-82.38.21-h5eee18bh0b41bf4_0
  setuptoolslibxcrypt          pkgs/mainconda-forge/linux-64::setuptoolslibxcrypt-654.64.336-py39h06a4308hd590300_01
  sqlitelibzlib             pkgs/mainconda-forge/linux-64::sqlitelibzlib-31.402.113-h5082296hd590300_05
  tkncurses                 pkgs/main/conda-forge/linux-64::tkncurses-86.64.1220240210-h1ccaba5h59595ed_0
  tzdataopenssl             pkgs/main/noarchconda-forge/linux-64::tzdata-2022g-h04d1e81_0
  wheelopenssl-3.2.1-hd590300_1
  pip                pkgs/main/linux-64conda-forge/noarch::wheelpip-24.0.38.4-py39h06a4308pyhd8ed1ab_0
  xzpython                 pkgs/main/conda-forge/linux-64::xzpython-53.29.1019-h5eee18bh0755675_0_1cpython
  zlibreadline               pkgs/mainconda-forge/linux-64::zlibreadline-18.2.13-h5eee18bh8228510_01
 Proceed ([y]/n)? y
...

Use the conda create -n myenv python=3.9 numpy=1.23.5 commands to create the myenv environment with a specific version of python and numpy.

Code Block
username@lanta:~> conda create -n myenv python=3.9 numpy=1.23.5
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /your directory/envs/myenv

  added / updated specs:
    - numpy=1.23.5
    - python=3.9

The following packages will be downloaded:

    package setuptools         conda-forge/noarch::setuptools-69.2.0-pyhd8ed1ab_0
  tk                 conda-forge/linux-64::tk-8.6.13-noxft_h4845f30_101
  tzdata             conda-forge/noarch::tzdata-2024a-h0c530f3_0
  wheel              conda-forge/noarch::wheel-0.43.0-pyhd8ed1ab_1
  xz                 conda-forge/linux-64::xz-5.2.6-h166bdaf_0

Proceed ([y]/n)?     |            build
    ---------------------------|-----------------
    blas-1.0                   |      y
...

Use the conda create -n myenv python=3.9 numpy=1.23.5 commands to create the myenv environment with a specific version of python and numpy.

Code Block
username@lanta:~> conda create -n myenv python=3.9 numpy=1.23.5
Channels:
 - conda-forge
Platform: linux-64
Collecting package metadata (repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /your directory/envs/myenv

  added / updated specs:
    - numpy=1.23.5
    - python=3.9


The following packages will be downloaded:

    package  mkl           6 KB     ca-certificates-2023.01.10 |       h06a4308_0     build
   120 KB ---------------------------|-----------------
    certifilibblas-20223.129.70           |   py39h06a4308_0|21_linux64_openblas          15014 KB  conda-forge
    intellibcblas-openmp-20213.49.0       |      h06a4308_3561|21_linux64_openblas          4.2 MB14 KB  conda-forge
    mkllibgfortran-ng-202113.42.0      |       h69a702a_5  |     h06a4308_640   23 KB  conda-forge
142.6 MB     mkl-service-2.4liblapack-3.9.0          |   py39h7f8727e_0|21_linux64_openblas          5914 KB  conda-forge
    mkl_fftnumpy-1.323.15               |   py39hd3c417cpy39h3d75532_0         5.6 MB 182 KBconda-forge
    mkl_randompython-13.29.219           |   py39h51133e4|h0755675_0_cpython        22.7 309 KBMB  conda-forge
    numpypython_abi-1.23.53.9             |        |   py39h14f42284_0cp39           106 KB  conda-forge
   numpy-base-1.23.5 wheel-0.43.0               |     py39h31eccc5pyhd8ed1ab_01          57 KB 6.7 MB conda-forge
    ----------------------------------------------------------------
                                           Total:        28.4 MB

The following NEW packages will be INSTALLED:

  _libgcc_mutex      Total:conda-forge/linux-64::_libgcc_mutex-0.1-conda_forge
  _openmp_mutex       154.3 MB

The following NEW packages will be INSTALLED:

  _libgcc_mutex      pkgs/main/linux-64::_libgcc_mutex-0.1-main
  _openmp_mutex      pkgs/main/linux-64::_openmp_mutex-5.1-1_gnu
  blasconda-forge/linux-64::_openmp_mutex-4.5-2_gnu
  bzip2              conda-forge/linux-64::bzip2-1.0.8-hd590300_5
  ca-certificates    conda-forge/linux-64::ca-certificates-2024.2.2-hbcca054_0
  ld_impl_linux-64   conda-forge/linux-64::ld_impl_linux-64-2.40-h41732ed_0
  libblas               pkgs/main/conda-forge/linux-64::blaslibblas-13.9.0-mkl21_linux64_openblas
  libcblas       ca-certificates    pkgsconda-forge/main/linux-64::calibcblas-certificates-20233.019.100-h06a430821_linux64_0openblas
  certifilibffi             pkgs/mainconda-forge/linux-64::certifilibffi-20223.124.72-py39h06a4308h7f98852_05
  intel-openmplibgcc-ng          pkgsconda-forge/main/linux-64::intellibgcc-openmpng-202113.42.0-h06a4308h807b86a_35615
  ld_impl_linux-64libgfortran-ng     pkgs/mainconda-forge/linux-64::ld_impl_linux-64-libgfortran-ng-13.2.380-h1181459h69a702a_15
  libffilibgfortran5             pkgs/main/conda-forge/linux-64::libffilibgfortran5-313.42.20-h6a678d5ha4646dd_65
  libgomp libgcc-ng           pkgs/mainconda-forge/linux-64::libgcclibgomp-ng-1113.2.0-h1234567h807b86a_15
  libgompliblapack            pkgs/mainconda-forge/linux-64::libgompliblapack-113.29.0-h1234567_121_linux64_openblas
  libnsl      libstdcxx-ng       pkgsconda-forge/main/linux-64::libstdcxx-nglibnsl-11.2.0.1-h1234567hd590300_10
  mkllibopenblas                pkgs/main/conda-forge/linux-64::mkllibopenblas-20210.43.026-h06a4308_640pthreads_h413a1c8_0
  libsqlite mkl-service         pkgs/mainconda-forge/linux-64::mkllibsqlite-service-23.445.02-py39h7f8727eh2797004_0
  mkl_fftlibstdcxx-ng            pkgs/mainconda-forge/linux-64::mkl_fft-1.3.1-py39hd3c417c_0libstdcxx-ng-13.2.0-h7e041cc_5
  libuuid   mkl_random         pkgsconda-forge/main/linux-64::mkl_randomlibuuid-12.238.21-py39h51133e4h0b41bf4_0
  ncurseslibxcrypt            pkgs/mainconda-forge/linux-64::ncurseslibxcrypt-64.4.36-h6a678d5hd590300_01
  numpylibzlib              pkgs/main/conda-forge/linux-64::numpylibzlib-1.232.513-py39h14f4228_0hd590300_5
  ncurses   numpy-base         pkgs/mainconda-forge/linux-64::numpyncurses-base-16.234.520240210-py39h31eccc5h59595ed_0
  numpy  openssl            pkgs/mainconda-forge/linux-64::opensslnumpy-1.123.1t5-h7f8727epy39h3d75532_0
  pipopenssl                pkgs/mainconda-forge/linux-64::pipopenssl-223.32.1-py39h06a4308_0hd590300_1
  pip   python             pkgs/main/linux-64conda-forge/noarch::pythonpip-324.9.160-h7a1cb2apyhd8ed1ab_0
  python  readline           pkgsconda-forge/main/linux-64::readlinepython-83.9.219-h5eee18bh0755675_0_cpython
  setuptoolspython_abi         pkgs/mainconda-forge/linux-64::setuptoolspython_abi-653.6.39-py39h06a43084_0cp39
  sixreadline                pkgs/main/noarch::six-1.16.0-pyhd3eb1b0conda-forge/linux-64::readline-8.2-h8228510_1
  sqlitesetuptools             pkgs/main/linux-64::sqlite-3.40.1-h5082296conda-forge/noarch::setuptools-69.2.0-pyhd8ed1ab_0
  tk                 pkgsconda-forge/main/linux-64::tk-8.6.1213-h1ccaba5noxft_h4845f30_0101
  tzdata             pkgs/main/noarch::tzdata-2022g-h04d1e81_0
  wheel              pkgs/main/linux-64conda-forge/noarch::wheel-0.38.4-py39h06a4308tzdata-2024a-h0c530f3_0
  xzwheel                 pkgs/main/linux-64::xz-5.2.10-h5eee18b_1
  zlibconda-forge/noarch::wheel-0.43.0-pyhd8ed1ab_1
  xz                 pkgs/mainconda-forge/linux-64::zlibxz-15.2.136-h5eee18bh166bdaf_0

Proceed ([y]/n)? y
...

Creating the environment in the project’s home

Specify a location for the environment

Use the conda create --prefix /your project directory/envs commands to create the environment on the specific location.

Code Block
username@lanta:~> conda create --prefix /your project directory/envs-prefix /your project directory/envs
Channels:
 - conda-forge
Platform: linux-64
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /your project directory/envs

Proceed ([y]/n)? y
...

Specify a location for the environment with a specific version of a package

Use the conda create --prefix /your project directory/envs python=3.9 commands to create the environment with a specific version of a package on a specific location.

Code Block
username@lanta:~> conda create --prefix /your project directory/envs python=3.9
Channels:
 - conda-forge
Platform: linux-64
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /your project directory/envs

  added / updated specs:
    - python=3.9

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    capython-certificates-20233.01.10 |9.19              h06a4308|h0755675_0_cpython        22.7 120 KBMB  conda-forge
    certifiwheel-2022.12.70.43.0               |     py39h06a4308pyhd8ed1ab_01          15057 KB  conda-forge
    ------------------------------------------------------------
                                           Total:        22.8 MB

The following NEW packages will be INSTALLED:

  _libgcc_mutex      conda-forge/linux-64::_libgcc_mutex-0.1-conda_forge
  _openmp_mutex      conda-forge/linux-64::_openmp_mutex-4.5-2_gnu
  bzip2     Total:         270 KB

The following NEW packages will be INSTALLED:

  _libgcc_mutex      pkgs/main/conda-forge/linux-64::bzip2-1.0.8-hd590300_5
  ca-certificates    conda-forge/linux-64::ca-certificates-2024.2.2-hbcca054_0
  ld_impl_linux-64   conda-forge/linux-64::ld_libgccimpl_mutexlinux-64-02.1-main40-h41732ed_0
  libffi       _openmp_mutex      pkgsconda-forge/main/linux-64::_openmp_mutex-5.1-1_gnulibffi-3.4.2-h7f98852_5
  ca-certificateslibgcc-ng          pkgsconda-forge/main/linux-64::calibgcc-certificatesng-202313.012.100-h06a4308h807b86a_05
  certifilibgomp            pkgs/mainconda-forge/linux-64::certifilibgomp-202213.122.70-py39h06a4308_0h807b86a_5
  libnsl          ld_impl_linux-64   pkgs/mainconda-forge/linux-64::ld_impl_linux-64libnsl-2.0.381-h1181459hd590300_10
  libffilibsqlite             pkgs/main/conda-forge/linux-64::libffilibsqlite-3.445.2-h6a678d5h2797004_60
  libuuid  libgcc-ng          pkgsconda-forge/main/linux-64::libgcclibuuid-ng-112.238.01-h1234567h0b41bf4_10
  libgomplibxcrypt            pkgs/mainconda-forge/linux-64::libgomplibxcrypt-114.24.036-h1234567hd590300_1
  libzlib     libstdcxx-ng       pkgsconda-forge/main/linux-64::libstdcxxlibzlib-ng-111.2.013-h1234567hd590300_15
  ncurses            pkgsconda-forge/main/linux-64::ncurses-6.4.20240210-h6a678d5h59595ed_0
  openssl            pkgs/mainconda-forge/linux-64::openssl-13.2.1.1t-h7f8727ehd590300_01
  pip                pkgs/main/linux-64conda-forge/noarch::pip-2224.3.10-py39h06a4308pyhd8ed1ab_0
  python             pkgs/mainconda-forge/linux-64::python-3.9.1619-h7a1cb2ah0755675_0_cpython
  readline           pkgsconda-forge/main/linux-64::readline-8.2-h5eee18bh8228510_01
  setuptools         pkgs/main/linux-64conda-forge/noarch::setuptools-6569.62.3-py39h06a4308_0
  sqlite             pkgs/main/linux-64::sqlite-3.40.1-h5082296-pyhd8ed1ab_0
  tk                 pkgs/main conda-forge/linux-64::tk-8.6.1213-h1ccaba5noxft_h4845f30_0101
  tzdata             pkgsconda-forge/main/noarch::tzdata-2022g2024a-h04d1e81h0c530f3_0
  wheel              pkgs/main/linux-64conda-forge/noarch::wheel-0.3843.40-py39h06a4308pyhd8ed1ab_01
  xz                 pkgs/main/linux-64::xz-5.2.10-h5eee18b_1
  zlib               pkgs/mainconda-forge/linux-64::zlibxz-15.2.136-h5eee18bh166bdaf_0

Proceed ([y]/n)? y
...

Activate your environment in the project’s home

If you want to activate your environment in the project’s home, you can use the conda activate /your project directory/envs command.

Code Block
username@lanta:~> conda activate /your project directory/envs
(/your project directory/envs) username@lanta:~>

Creating the environment from an requirements.yml file

A simple requirements.yml file

In the requirements.yml file, you need to specify the environment name and packages that you want to use.

Code Block
name: envs
dependencies:
  - python=3.9
  - numpy=1.23.5
  - pandas

Create the environment from the requirements.yml file in the user’s home

Use the conda env create -f requirements.yml commands to create the environment from the requirements.yml file in the user’s home.

Code Block
username@lanta:~> conda env create -f requirements.yml
Channels:
 - conda-forge
Platform: linux-64
Collecting package metadata (repodata.json): done
Solving environment: done

Downloading and Extracting Packages

Preparing transaction: done
Verifying transaction: done
Executing transaction: done

Create the environment from the requirements.yml file in the project’s home

Use the conda env create -f requirements.yml --prefix /your project directory/envs commands to create the environment from the requirements.yml file on the specific location.

Code Block
username@lanta:~> conda env create -f requirements.yml --prefix /your project directory/envs
Channels:
 - conda-forge
Platform: linux-64
Collecting package metadata (repodata.json): done
Solving environment: done

Downloading and Extracting Packages

Preparing transaction: done
Verifying transaction: done
Executing transaction: done

Removing the environment

Remove the environment in the user’s home

If you want to remove the myenv environment, you can use the conda remove --name myenv --all command.

Code Block
username@lanta:~> conda remove --name myenv --all

Remove the environment in the project’s home

If you want to remove the environment in /your project directory/envs, you can use the rm -rf /your project directory/envs command.

Code Block
username@lanta:~> rm -rf /your project directory/envs

...

Related articles

Filter by label (Content by label)
showLabelsfalse
max5
spacescom.atlassian.confluence.content.render.xhtml.model.resource.identifiers.SpaceResourceIdentifier@48ae393
showSpacefalse
sortmodified
showSpacetypefalsepage
reversetrue
typelabelspagesingularity python container
cqllabel in ( "vir-env" , "python-script" , "jupyter" ) and space = currentSpace ( )labelssingularity python container