...
5. When the job has completed, open check the last -10 lines of .out log file. This creates a temp directory under TMPLOCATION_TO_CREATE_HAZARD_FILES
specified, and places empirical files (symbolic links) and bash scripts that contain Python commands.
Code Block |
---|
baes@mahuika02: ~/tmp$ tail -10 hazard_search_multi-85422.out
Instructions in the multicase are not written in extense as it is not useful. Please use the scripts below
Please go to hazard/
Then run the scripts created as:
bash /home/baes/cybershake/v18p6/Hazard/hazard_search_5F73LY_baes/hazard_calcs.sh
bash /home/baes/cybershake/v18p6/Hazard/hazard_search_5F73LY_baes/deagg_calcs_im_value.sh
bash /home/baes/cybershake/v18p6/Hazard/hazard_search_5F73LY_baes/deagg_calcs_exceedance_rate.sh
Note: The IM_VALUE and EXCEEDANCE should be adjusted on the deagg_* scripts
Mon Sep 3 03:30:39 UTC 2018 |
This means it has created a temp directory
6. In this example. the temp location is /home/baes/cybershake/v18p6/Hazard/hazard_search_5F73LY_baes
and placed empirical files (symbolic links) and bash scripts that contain Python commands.
6. Let's call this temp location a working directory.
7. There is hazard_calcs.sh
in the working directory. For entire cybershake, this can be very very long. We will be using SLURM's parallel for loop to run this in parallel, but it needs to be split to avoid SLURM complaining about too many lines. This involves quite a bit of steps, but it can be largely automated by executing prepare_hpc_hazard_calc.sh
. Go to the working directory, and execute it. You just need to supply the path to the working directory.
Code Block |
---|
bash hazard/mahuika/prepare_hpc_hazard_calc.sh /home/baes/cybershake/v18p6/Hazard/hazard_search_5F73LY_baesbaes@mahuika02: ~/cybershake/v18p6/Hazard/hazard_search_gvb4cJ_baes$ bash /nesi/project/nesi00213/deploy/seisfinder2/CLI/hazard/mahuika/prepare_hpc_hazard_calc.sh . |
The above does EVERYTHING for you. It copies the .sl template to the working directory, splits the hazard_calc.sh, and generates all the .sl files ready for submission.
Code Block |
---|
baes@mahuika02: ~/cybershake/v18p6/Hazard/hazard_search_5F73LY_baes$ bash ./submit_all.sh Submitted batch job 69390 Submitted batch job 69391 Submitted batch job 69392 Submitted batch job 69393 Submitted batch job 69394 Submitted batch job 69395 Submitted batch job 69396 Submitted batch job 69397 Submitted batch job 69398 Submitted batch job 69399 Submitted batch job 69400 Submitted batch job 69401 Submitted batch job 69402 Submitted batch job 69403 Submitted batch job 69404 Submitted batch job 69405 Submitted batch job 69406 Submitted batch job 69407 Submitted batch job 69408 |
9. Hazard map: When everything is completed, you can submit the following .sl script that has been automatically generated for you. Just edit the exceedance value if required. For details, see https://github.com/ucgmsim/seisfinder2/tree/master/CLI/hazard
Code Block |
---|
baes@mahuika02: ~/cybershake/v18p6/Hazard/hazard_search_5F73LY_baes$ sbatch execute_hazard_map.sl |
...