TPlease read the readme @ https://github.com/ucgmsim/IM_calculation/blob/master/README.md for instructions on how to run the code.
DONE
- IM calculations have been separated from the "old post-processing" repository, extracting the relevant functions and classes.
- IM values validated on Hypocentre and Kupe against "old post-processing" on the same data.
- Two types of workflows: text based (most likely observations) and binary based (simulations once the binary workflow is in place).
- If binary workflow does not happen soon, the text based option will be used in both cases.
- Outputs match the formats requested in File Formats Used On GM and should therefore be usable on the upcoming Non-ergodic codes.
Tested on very simple multi-process on Kupe with good speed-up using 40 and 80 cores. For the sample, 2228 stations were used
Machine Cores Time Hypocentre 1 132m Hypocentre 8 8.7m Kupe 40 27m Kupe 80
OUTPUT STRUCTURE
With command : python calculate_ims.py ../BB.bin b -o /home/yzh231/ -i Albury_666_999 -r Albury -t s -v 18p3 -n 112A CMZ -m PGV pSA -p 0.02 0.03 -e -c geom -np 2
- input file path: ../BB.bin
- b: input file type is binary
- -o: output result csvs location is /home/yzh231, default is /home/$user
- -i: output folder name is Albury_666_999, default is all_station_ims
- -r: rupture name is Albury, default is unknown
- -t: type of simrun is simulated, default is unknown
- -v: version of simrun is v18p3, default is XXpY
- -n: station names used to perform im claculation are 112A and CMZ, default is all the stations in the binary file
- -m: measures used to perform im calculation are PGV and pSA, default is all the measures
- -p: period of pSA used to perform im calculation are 0.02 0.03, default is Karim's 15 periods
- -e: In addition to the period specified by -p option, use extended 100 period of pSA, default not using
- -c: component of waveform acceleration used to perform im calculation is geom, default is '090, 000, ver'
- -np: number of processors used to perform im calculation is 2, default is 2
The result is outputted to the following location, where:
- Albury_666_999.csv is the summary csv file that contains all stations im calcualtions
- Albury_666_999.info is the meta data file.
- station is the folder that contains all individual station's im_calculations
- 112A_geom.csv is the individual csv file that contains geom component im calculation for station 112A
TODO
- Creation of semi-automatic slurm generation that will have all the calls to produce the results as needed.
- Progress printing statements
- Sim ASCII calculation - currently assumes ASCII file is in g for acceleration but this is not the case for sim
- Rrup calculation on a smaller station list - currently when generating the slurm script it does the full grid even for stations outside the domain
Notes
- Extensive re-writing of code needs to have smaller deliverables in the future, as this simplifies the integration.