...

V17p9

workflow

1. create a file constains a list of vm models to run(since

   its

   it is currently 1 to N srf)

   Code Block
   cd v17p9/Data/Vms ls | split -l 10 - list_vm

   this should output something like this:

   Code Block

   -rw-rw---- 1 ykh22 nesi-users 94 Oct 2 03:20 list_vma -rw-rw---- 1 ykh22 nesi-users 91 Oct 2 03:20 list_vmb -rw-rw---- 1 ykh22 nesi-users 84 Oct 2 03:20 list_vmc -rw-rw---- 1 ykh22 nesi-users 108 Oct 2 03:20 list_vmd -rw-rw---- 1 ykh22 nesi-users 82 Oct 2 03:20 list_vme -rw-rw---- 1 ykh22 nesi-users 62 Oct 2 03:20 list_vmf -rw-rw---- 1 ykh22 nesi-users 105 Oct 2 03:20 list_vmg -rw-rw---- 1 ykh22 nesi-users 96 Oct 2 03:20 list_vmh -rw-rw---- 1 ykh22 nesi-users 51 Oct 2 03:20 list_vmi

2. run install_cybershake.py with the path to the list of vm models and the path to install to

   Code Block
   /nesi/projects/nesi00213/RunFolder/Cybershake/workflow/devel/cybershake/install_cybershake.sh list_source.txt

   cd Runs

   $gmsim/RunFolder/Cybershake/v17p9/Data/list_vma /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9

   this should create all the simulation folders in the list_vm*

   Code Block
   Albury AlpineF2K AlpineK2T Ashley AwatNEVer AwatNEVerCl AwatereNE AwatereSW Barefell Brothers !!!!SIM_DIR:/nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/Albury Generation of model params has been skipped. Re-directing related params to files under /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Data/VMs/Albury /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/Albury Permission /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/Albury : 750 **************************************************************************************************** **************************************************************************************************** Producing statcords and FD_STATLIST. It may take a minute or two /nesi/projects/nesi00213/StationInfo/non_uniform_whole_nz_with_real_stations-hh400_17062017.ll From: /nesi/projects/nesi00213/StationInfo/non_uniform_whole_nz_with_real_stations-hh400_17062017.ll To: /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/Albury/fd_rt01-h0.400.statcords /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/Albury/fd_rt01-h0.400.ll Done !!!!SIM_DIR:/nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/AlpineF2K Generation of model params has been skipped. Re-directing related params to files under /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Data/VMs/AlpineF2K /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/AlpineF2K Permission /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/AlpineF2K : 750 **************************************************************************************************** **************************************************************************************************** Producing statcords and FD_STATLIST. It may take a minute or two /nesi/projects/nesi00213/StationInfo/non_uniform_whole_nz_with_real_stations-hh400_17062017.ll From: /nesi/projects/nesi00213/StationInfo/non_uniform_whole_nz_with_real_stations-hh400_17062017.ll To: /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/AlpineF2K/fd_rt01-h0.400.statcords /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/AlpineF2K/fd_rt01-h0.400.ll Done ... ... ... !!!!SIM_DIR:/nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/Brothers Generation of model params has been skipped. Re-directing related params to files under /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Data/VMs/Brothers /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/Brothers Permission /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/Brothers : 750 **************************************************************************************************** **************************************************************************************************** Producing statcords and FD_STATLIST. It may take a minute or two /nesi/projects/nesi00213/StationInfo/non_uniform_whole_nz_with_real_stations-hh400_17062017.ll From: /nesi/projects/nesi00213/StationInfo/non_uniform_whole_nz_with_real_stations-hh400_17062017.ll To: /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/Brothers/fd_rt01-h0.400.statcords /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/Brothers/fd_rt01-h0.400.ll Done
   Code Block
   cd $gmsim/Runfolder/Cybershake/v17p8/Runs

3. run submit_cybershake_emod3d.sh ( this will submit EMOD3D for all the simulation will the maximum WCT estimated)

   Code Block
   /nesi/projects/nesi00213/RunFolder/Cybershake/workflow/devel/cybershake/submit_cybershake.sh /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs /nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Data/list_vma

   IMPORTANT!! : make sure the list_vm is the same as the one used in install_cybershake. (or has been installed properly by any means)

   Code Block

   nx=286 ny=272 nz=105 sim_duration=55 num_procs=512 Maximum: 0:06:07.273212 Average: 0:00:51.445334 Minimum: 0:00:00 Loadleveler script run_emod3d_Albury_HYP01-01_S1244.ll written Submitting run_emod3d_Albury_HYP01-01_S1244.ll Loadleveler script run_emod3d_Albury_HYP01-01_S1254.ll written Submitting run_emod3d_Albury_HYP01-01_S1254.ll Loadleveler script run_emod3d_Albury_HYP01-01_S1264.ll written Submitting run_emod3d_Albury_HYP01-01_S1264.ll .. .. .. nx=372 ny=356 nz=113 sim_duration=69 num_procs=512 Maximum: 0:14:04.156170 Average: 0:01:58.244117 Minimum: 0:00:00 Loadleveler script run_emod3d_Brothers_HYP01-02_S1244.ll written Submitting run_emod3d_Brothers_HYP01-02_S1244.ll Loadleveler script run_emod3d_Brothers_HYP01-02_S1254.ll written Submitting run_emod3d_Brothers_HYP01-02_S1254.ll Loadleveler script run_emod3d_Brothers_HYP01-02_S1264.ll written Submitting run_emod3d_Brothers_HYP01-02_S1264.ll Loadleveler script run_emod3d_Brothers_HYP02-02_S1274.ll written Submitting run_emod3d_Brothers_HYP02-02_S1274.ll Loadleveler script run_emod3d_Brothers_HYP02-02_S1284.ll written Submitting run_emod3d_Brothers_HYP02-02_S1284.ll Loadleveler script run_emod3d_Brothers_HYP02-02_S1294.ll written Submitting run_emod3d_Brothers_HYP02-02_S1294.ll

4. after all EMOD3D finished, run submit_cybershake_post_emod.sh

5. run check_cybershake_post_emod.sh to check which simulation have not yet finished
   the result will be in a text file under same directory.
   *important note: this is very likely to change when migrated whole workflow to new CREY machine.(since it will not be using load leveller)

6.  

TODO

• add script to auto test all simulations and submit the next step
  (currently need to run the test script and submit the next step manually)