How to run analysis pipelines at Bologna (CNAF) computer center

Introduction

Gergely.Debreczeni@cern.ch

The procedure

1. Logg in to one of the following machines

        ui01-virgo.cr.cnaf.infn.it.
        ui02-virgo.cr.cnaf.infn.it.
       

   These are the User Interface machine which shares the following directories with the Worker Nodes:

       /storage/gpfs_virgo3/home
       /storage/gpfs_virgo3/scratch
       /storage/gpfs_virgo3/virgo
     

   If possible use the scratch area, since it is world readable.
2. Change to one of the shared directories.

       (cmd.: cd /storage/gpfs_virgo3/home/gdebrecz)
       

3. IMPORTANT: Set the file creation mask to 0002, i.e. the files you are creating from now on will be group writeable.

      (cmd.: umask 0002)
       

4. Create a new directory, and enter into it.

       (cmd.: mkdir mywd; cd mywd)
       

5. Source VIRGO environment setting file:

      (cmd.:  . /opt/exp_software/virgo/lscsoft/etc/virgoenv.sh)
       

6. Launch some condor test job and check whether it works fine or not.

       (cmd:.
       cp /storage/gpfs_virgo3/home/gdebrecz/condortest/* .
       condor_submit vog-testjob.des
       )
       

7. If the testjobs finished OK, then from this point on you can do everything in the same way as on other clusters. Except the fact, that you have to copy the

       /opt/exp_software/virgo/lscsoft/etc/LSCdataFind
        

   executable and overwrite the one comes with the standard LSCsoft installation !

BE AWARE, that all your files and software _should be installed on the shared areas_ and should be group read/writeable so that your jobs on the Worker Nodes - which are running as a different user - could access it !

Useful remarks

1. You can find a test installation as an example here:

       /opt/exp_software/virgo/lscsoft/
       

   for S5 GRB runs or under /storage/gpfs_virgo3/home/gdebrecz/lscsoft/ /storage/gpfs_virgo3/home/gdebrecz/lscsoft/non-lsc for the s6_20090722 branch.

       /opt/exp_software/virgo/lscsoft/etc/s5grbenv.sh
        

   to see how I source the various files.
2. The system python installation should not be used, use the one installed in the above software area , this is automatically happens if you source the

      /opt/exp_software/virgo/lscsoft/etc/virgoenv.sh
     

   file
3. An automated software installation script is available under

       /storage/gpfs_virgo3/home/gdebrecz/scripts
      

   See the description inside on how to use it.