Ceci est une ancienne révision du document !


Miniconda within Singularity

Because lumière cluster is based on an old operating system (Centos 6.10), GLIBC errors may occur when installing or using conda packages.

The idea is to use a more recent version of GLIBC embedded in a singularity container.

advantage: access to the most recent version of Python and the majority of recent packages.

disadvantage: lack of conda activate and deactivate options.It is therefore impossible to use conda activate.

We have created a wrapper around conda called conda_sing.

This new command will replace the classical conda command.

First load the dedicated environment :

$ module load miniconda/singularity

Create new environment

Create a new environment called myEnv

$ conda_sing create -n myEnv

To list conda environments

$ conda_sing env list

Install new packages in the environment

Traditionally, the environment is activated to install the packages. This feature is not available with singularity.

To install package inside environment:

$ conda_sing install -n myEnv package1 package2

Run program in the environment

To run program using Singularity :

$ conda_sing run -n myEnv python myProgram.py

SGE script

anaconda.sge
#!/bin/bash
 
#$ -q all.q
 
#$ -l h_vmem=6G ## job will cancel if memory exceed
 
#$ -N Test_anaconda
 
module load miniconda/singularity
 
conda_sing run -n myEnv python myProgram.py
  • anaconda_sing.1701976209.txt.gz
  • Dernière modification : 2023/12/07 19:10
  • de admin