Background:

New Cybershake install structure (realization/[HF|LF|BB]) with yaml only and params*.py removed (prams_vel.py.template and params.py.template still present because they are not genareted by install) now available.

Parameter Folder Structure: Parameters and locations in new folder hierarchy

Tasks: 

  1. Clean up the manual workflow and testing code.  1d
  2. Then merge params branch into master and do benchmark testing   6h
  3. Create dummy templates for each level of yaml     6h
  4. Discuss dummy templates with team      2h
  5. Create functionalities to revtrive dummpy templates by user specified verison  4h
  6. Benchmark testing 4h
  7. merge Jonney's folder_restruck into params branch 3h
  8. Modify params branch acoording to pull request comments 6h
  9. Store location of parent yaml config in child conifg   1d
  10. Benchmark testing 4h

Progress:

 1-9 all done. Currently only find defaults in root_params.yaml


Sample dummy template:

slurm_gm_workflow/templates/gmsim/16.1/root_defaults.yaml

hf:
  hf_dt: 0.005
  hf_rvfac: 0.8
  hf_sdrop: 50
  hf_path_dur: 1
  hf_kappa: 0.045
bb:
  site_specific: false
  fmin: 0.2
  fmidbot: 0.5
flo: 0.25

How to run the manual install:

python ~/slurm_gm_workflow/scripts/install.py --user_root ~/Albury_new_bench/ --srf_dir ~/Albury_new_bench/Data/Sources/ --vm_dir ~/Albury_new_bench/Data/VMs/ --version 16.1
python ~/slurm_gm_workflow/scripts/submit_emod3d.py --srf Albury_HYP15-21_S1384
python ~/slurm_gm_workflow/scripts/submit_post_emod3d.py --srf Albury_HYP15-21_S1384 --merge_ts
python ~/slurm_gm_workflow/scripts/install_bb.py
python ~/slurm_gm_workflow/scripts/submit_hf.py --binary --srf Albury_HYP15-21_S1384 --rand_resetsrf
python ~/slurm_gm_workflow/scripts/submit_bb.py --binary

Testing results for manual install

Benchmark: v18p6 Albury-HYP15-1384 run with original master manual install

Test's e3ds in LF/Outbin are the same benchmark's.

Test's BB/HF.bin are the same benchmark's.

Adjust the cybershake install wrapper

Now we have finished the inner layer of cybershake manul install functionlities, we can move onto adjusting the outer layer install wrapper to utilized the yaml feature.

Main scripts being changed are: install_cybershake.py and auto_submit.py

Tasks:

  1. remove usage of params*.py from install_cybershake.py 1d
  2. remove usage of params*.py  auto_submit.py 1d
  3. Benchmark Test 4h


Clean up the cybershake Submission

Files to tar or keep at the end of cybershake submission 

                                                  

Todo

Passing 'version' from cybershake config instaed of command line argument

Move install_bb  to install stage, before submit_emod3d



  • No labels