You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 38 Next »

Running hazard search for entire Cybershake on Mahuika

You may wish to install python packages geopy, psycopg2, numpy, pyarrow, etc. Use pip install --user to install missing packages.

pip install geopy psycopg2 shapely --user

Consider upgrading pip by

pip upgrading pip --user

then update PATH to use the pip in $HOME/.local/bin/pip

 

Make sure all the IM Agg have been computed and stored under each fault of Cybershake IMs directory. ie.  /nesi/nobackup/nesi00213/RunFolder/Cybershake/v18p6/IMs/XXXX/IM_agg 


Setup

Setup part may need updating. imdb_create needs to be added too

module add Python/2.7.14-gimkl-2017a
baes@mahuika02: /nesi/nobackup/nesi00213/RunFolder/Cybershake/v18p6$ python /nesi/project/nesi00213/deploy/seisfinder2/tool/setup.py --help 

usage: setup.py [-h] [-n NAME] cybershake_dir empirical_dir ll_file
positional arguments:
  cybershake_dir        Cybershake Root directory eg.
                        /nesi/nobackup/nesi00213/RunFolder/Cybershake/v18p6
  empirical_dir         Empirical data root directory eg.
                        /nesi/nobackup/nesi00213/empiricals/v18p5
  ll_file               Path to the .ll file
optional arguments:
  -h, --help            show this help message and exit
  -n NAME, --name NAME  Optional name for Cybershake
baes@mahuika02: /nesi/nobackup/nesi00213/RunFolder/Cybershake/v18p6$ python /nesi/project/nesi00213/deploy/seisfinder2/tool/setup.py . /nesi/nobackup/nesi00213/empiricals/v18p5 non_uniform_whole_nz_with_real_stations-hh400_v18p6.ll -n v18p6


This creates a config.yaml that contains the all the necessary config info, creates fault lists, converts .ll into .csv etc, and build IMDB.

 

A sample config.yaml looks like this

empirical_dir: /nesi/nobackup/nesi00213/empiricals/v18p6
fault_list: /scale_wlg_nobackup/filesets/nobackup/nesi00213/RunFolder/Cybershake/v18p6_2/fault_list.csv
hazard_dir: /scale_wlg_nobackup/filesets/nobackup/nesi00213/RunFolder/Cybershake/v18p6_2/Hazard
ll: /scale_wlg_nobackup/filesets/nobackup/nesi00213/RunFolder/Cybershake/v18p6_2/non_uniform_whole_nz_with_real_stations-hh400_v18p6_land.ll
name: v18p6_2
root_dir: /scale_wlg_nobackup/filesets/nobackup/nesi00213/RunFolder/Cybershake/v18p6_2
runs_dir: /scale_wlg_nobackup/filesets/nobackup/nesi00213/RunFolder/Cybershake/v18p6_2/Runs
srf_dir: /scale_wlg_nobackup/filesets/nobackup/nesi00213/RunFolder/Cybershake/v18p6_2/Data/Sources

 

Run

baes@mahuika02: ~$ python ~/seisfinder2/site/seisfinder.py --cs-version v18p6_2 --im SA_5p0 --location -42.7012 172.8003 --hazard

This calculates hazard for the given location for SA_5p0.

You can use a CSV file that contains latitude and longitude of multiple locations.

baes@mahuika02: ~$ python ~/seisfinder2/site/seisfinder.py --cs-version v18p6_2 --im SA_5p0 --csv /nesi/nobackup/nesi00213/RunFolder/Cybershake/v18p6_2/test.csv --hazard


If you put --script option, it won't do the calculation. Instead it will output a file hazard_calcs.sh in the current directory. This is useful if you wish to use NeSI to run hazard calculation for all locations.

baes@mahuika02: ~$ python ~/seisfinder2/site/seisfinder.py --cs-version v18p6_2 --im SA_5p0 --csv /nesi/nobackup/nesi00213/RunFolder/Cybershake/v18p6_2/test.csv --hazard --script


Suppose there is ~/hazard_calcs.sh. You can run prepare_hpc_hazard.calcs.sh for SLURM submission.

baes@mahuika02: ~$ bash /nesi/project/nesi00213/deploy/seisfinder2/site/mahuika/prepare_hpc_hazard_calc.sh 

Found working directory /nesi/nobackup/nesi00213/RunFolder/Cybershake/v18p6_2/Hazard/SA_5p0
Found 80 unique locations
Making a slurm script for processing locations 0 - 80
....Done!!
Go to the following directory and run submit_all.sh
/nesi/nobackup/nesi00213/RunFolder/Cybershake/v18p6_2/Hazard/SA_5p0/slurm

 

Everything you need is placed in the directory. Go to the directory and execute submit_all.sh (SLURM doesn't like to process more than 10000 lines. If there are more locations than the limit, it will create multiple .sl scripts and submit_all.sh will submit them all for you)

baes@mahuika02: /nesi/nobackup/nesi00213/RunFolder/Cybershake/v18p6_2/Hazard/SA_5p0/slurm$ ./submit_all.sh
Submitted batch job 69390
Submitted batch job 69391
Submitted batch job 69392
Submitted batch job 69393
...

 

Hazard map: When everything is completed, you can submit the following .sl script that has been automatically generated for you. Just edit the exceedance value if required.  For details, see https://github.com/ucgmsim/seisfinder2/tree/master/CLI/hazard

baes@mahuika02: /nesi/nobackup/nesi00213/RunFolder/Cybershake/v18p6_2/Hazard/SA_5p0/slurm$ sbatch execute_hazard_map.sl

 

 


  • No labels