From Documentation
Revision as of 16:49, 9 January 2013 by Roberpj (Talk | contribs)

Jump to: navigation, search
LS-DYNA
Description: Suite of programs for transient dynamic finite element program
SHARCNET Package information: see LS-DYNA software page in web portal
Full list of SHARCNET supported software



USAGE INSTRUCTIONS

These usage instructions apply to the module based installation of lsdyna found under directory /opt/sharcnet/lsdyna on licensed clusters shown in the above Availability Table. To access and use this software you must be a member of the lsdyna group. Users who belong to a licensed department will be given a 5 digit port number. The value should then be inserted into the appropriate departmental export statement before loading the module file as follows:

Step1 - SPECIFY SHARCNET SERVER

o UWO Civil and Environmental Engineering Dept

export LSTC_LICENSE_SERVER='PortNumber'@license1.uwo.sharcnet

o McGill Mechanical Engineering Department

export LSTC_LICENSE_SERVER='PortNumber'@license2.uwo.sharcnet

o UW Mechanical and Mechatronics Engineering Dept

export LSTC_LICENSE_SERVER='PortNumber'@license3.uwo.sharcnet


Step2 - LOAD LSDYNA MODULE

o For serial or threaded jobs (using ls971 version 6.0.0 or 6.1.0) do:

module load lsdyna/ls971smp6.1.0

o For mpi jobs (using ls971 version 6.0.0 or 6.1.0) do:

module unload intel openmpi lsdyna
module load intel/11.1.069 openmpi/intel/1.5.4 lsdyna/ls971mpp6.1.0

o For serial or threaded jobs (using version ls980) do:

module load lsdyna/ls980smpB1

o For mpi jobs (using version ls980) do:

module unload intel openmpi lsdyna
module load intel/12.1.3 openmpi/intel/1.4.5 lsdyna/ls980mppB1

Step3 - RUN AIRBAG EXAMPLE

To run lsdyna in single precision specify lsdyna_s on the sqsub command line, to run in double precision specify lsdyna_d. The following shows sample sqsub jobs submission for the airbag example http://www.dynaexamples.com/examples-manual/misc/airbag to the serial, threaded and mpi queus on sharcnet.

cp -a /opt/sharcnet/lsdyna/ls971smp6.1.0/examples /work/$USER/test-lsdyna
cd /work/$USER/test-lsdyna/misc/airbag
gunzip airbag.deploy.k.gz

o SUBMIT 1CPU SERIAL JOB

sqsub -r 7d -q serial -o ofile.%J --mpp=2G lsdyna_d i=airbag.deploy.k ncpu=1 

o SUBMIT 4CPU SMP JOB

sqsub -r 7d -q threaded -n 4 -o ofile.%J --mpp=2G lsdyna_d i=airbag.deploy.k ncpu=4

o SUBMIT 4CPU MPI JOB

sqsub -r 7d -q mpi -n 4 -o ofile.%J --mpp=1G lsdyna_d i=airbag.deploy.k


CHECKING JOB STATUS

To check the status of your job in the queue use the sqjobs command. On x86_64 systems you can check whether any of your jobs are queued on the license server use lstc_qrun. Its possible that sqsub will start your job but it will sit idle until enough license are available on the license server and the lstc_qrun command will reveal this:

[roberpj@hnd19:~/samples/lsdyna] lstc_qrun
Defaulting to server 1 specified by LSTC_LICENSE_SERVER variable
 
                     Running Programs
 
    User             Host          Program              Started       # procs
-----------------------------------------------------------------------------
hsnmoham    12208@orc271.orca.shar MPPDYNA          Mon Jan  7 18:17    24
 roberpj     9767@hnd15            LS-DYNA_971      Mon Jan  7 19:42     4
No programs queued


CHECKING LICENSE DETAILS

At the time of this writing UWO is running on a 4cpu demo license as follows:

[roberpj@hnd19:~/samples/lsdyna]  lstc_qrun -R
Defaulting to server 1 specified by LSTC_LICENSE_SERVER variable
 
LICENSE INFORMATION
 
PROGRAM          EXPIRATION CPUS  USED   FREE    MAX | QUEUE
---------------- ----------      ----- ------ ------ | -----
LS-DYNA_971      05/31/2013          -    172    200 |     0
 roberpj     9767@hnd15              4
MPPDYNA_971      05/31/2013          0    172    200 |     0
LS-DYNA          05/31/2013          0    172    200 |     0
MPPDYNA          05/31/2013          -    172    200 |     0
 hsnmoham   12208@orc271.orca.sharcnet  24
                   LICENSE GROUP    28    172    200 |     0
 
PROGRAM          EXPIRATION CPUS  USED   FREE    MAX | QUEUE
---------------- ----------      ----- ------ ------ | -----
LS-OPT           05/31/2013          0    200    200 |     0
                   LICENSE GROUP     0    200    200 |     0


SHOW LSDYNA MODULES

At the time of this writing the following modules were available on orca:

[roberpj@orc-login2:~] module avail lsdyna
---------------- /opt/sharcnet/modules -------------------
lsdyna/ls971mpp6.0.0 lsdyna/ls971smp6.0.0 lsdyna/ls980mppB1
lsdyna/ls971mpp6.1.0 lsdyna/ls971smp6.1.0 lsdyna/ls980smpB1



SUBMITTING JOBS USING LEGACY VERSIONS

The following binaries remain available on saw and orca for backward compatibility testing. There are no sharcnet modules for these versions hence jobs should be submitted using the recipe in the next stanza:

[roberpj@orc-login2:~] cd /opt/sharcnet/local/lsdyna
[roberpj@orc129:/opt/sharcnet/local/lsdyna] ls ls971*
ls971_d_R3_1    ls971_d_R4_2_1  ls971_s_R3_1    ls971_s_R4_2_1  ls971_s_R5_1_1
ls971_d_R4_2_0  ls971_d_R5_0    ls971_s_R4_2_0  ls971_s_R5_0

To submit a job, the following procedure is recommended:

module load lsdyna
export PATH=/opt/sharcnet/local/lsdyna:$PATH
export LSTC_LICENSE_SERVER=XXXXX@license3.uwo.sharcnet
cp /opt/sharcnet/local/lsdyna/examples/airbag.deploy.k airbag.deploy.k
SERIAL JOB:  sqsub -q serial -r 1d -o ofile.%J ls971_d_R4_2_1 i=airbag.deploy.k
THREADED JOB:  sqsub -q threaded -n 4 -r 1d -o ofile.%J ls971_d_R4_2_1 ncpu=4 para=2 i=airbag.deploy.k