Setup
activate_env /work/06833/sungbae/stampede2/Environments/stampede python $gmsim/workflow/scripts/cybershake/install_cybershake.py . list_all_r 20.1.6.4 --extended_period --stat /nesi/project/nesi00213/StationInfo/geoNet_stats+2019-04-18.ll
WARNING: Check the version template - hf 5.4.6.1.2 is not supported.
Modify task_cofig.yaml to select the steps of workflow to run.
Run
python $gmsim/workflow/scripts/cybershake/run_cybershake.py . leer task_config.yaml
Possible Gotchas
Upon a job submission, stampede2 gives an output like this:
(python3_stampede) sungbae@stampede23(180):/scratch/06833/sungbae/RunFolder/Validation/v20p1p19/Runs/396/396$ sbatch run_emod3d_396_20200116_195129.sl
-----------------------------------------------------------------
Welcome to the Stampede2 Supercomputer
-----------------------------------------------------------------
No reservation for this job
--> Verifying valid submit host (login3)...OK
--> Verifying valid jobname...OK
--> Enforcing max jobs per user...OK
--> Verifying availability of your home dir (/home1/06833/sungbae)...OK
--> Verifying availability of your work dir (/work/06833/sungbae/stampede2)...OK
--> Verifying availability of your scratch dir (/scratch/06833/sungbae)...OK
--> Verifying valid ssh keys...OK
--> Verifying access to desired queue (normal)...OK
--> Verifying job request is within current queue limits...OK
--> Checking available allocation (DesignSafe-Graves)...OK
Submitted batch job 5075750
Workflow code has been altered to support this, but there may be some error messages that our code can't handle yet, such as below.
Error Messages
-----------------------------------------------------------------
Welcome to the Stampede2 Supercomputer
-----------------------------------------------------------------
--> Submission error: please define total core count with the "-n" option'
-----------------------------------------------------------------
Welcome to the Stampede2 Supercomputer
-----------------------------------------------------------------
No reservation for this job
--> Verifying valid submit host (login3)...OK
--> Verifying valid jobname...OK
--> Enforcing max jobs per user...FAILED
[*] Too many simultaneous jobs in queue.
--> Max job limits for sungbae = 50 jobs