Run the genCSV.py
python /nesi/projects/nesi00213/workflow/genCSV.py -location Christchurch -datetime 2010-09-04-04:30:00 -exetime 201705301501 -mag 6.8 |
-datetime is the time when the earthquake happened, and must have the formate : %Y-%M-%D-hh-mm-ss
*if the event has not yet happened, use : -datetime Future
-exetime is when the simulation is ran, and must fit the formate: %Y%M%%Dhhmm, e.g. 201705301501
Note: In default , the meta data should be located under CSV folder. But if you are creating metadata for other user's simulation you can pass an extra argument to genCSV for it to save at specific place.
python /nesi/projects/nesi00213/workflow/genCSV.py -location Christchurch -datetime 2010-09-04-04:30:00 -exetime 201705301501 -mag 6.8 -save ~/metadata/20100904 |
Important: run 'source path.sh' before running other steps. If the running folder was not created follow the wiki page Real-time Ground Motion Simulation Setup
plot_srf_map.py src_model.srf
$plot_srf_map.py Ian02_s103245.srf |
plot_srf_square.py src_model.srf
plot_srf_square.py Ian02_s103245.srf |
note: this step requires observation generated, please follow the wiki page referring How to create observation files
*uses non_uniform_grid and prune out the virtual stations manually if you are making document for future event.
plot_vs30.py sim_folder
plot_vs30.py /home/nesi00213/RealTime/20161213_Kaikoura_m7p8_201705301501 |
note: this step requires observation generated, please follow the wiki page referring How to create observation files
plot_obs.py sim_folder
plot_obs.py . |
plot_ts.py processes
plot_ts.py 30 |
note: if files missing, try looking at the realtime sim wikipage referencing "plot_transfer.py auto"
plot_transfer.py auto folder_path_on_fitz local_path user_on_fitzroy $plot_transer.py auto /nesi/projects/nesi00213/RunFolder/baes/AlpineFault_Rupture_VMSI_v1p65_200m-h0p200_EMODv3p0p4_170531_s2n/ . ykh22 |
important: the original plot_ts.py will combine all ts.png into a mov file and delete all the png files. MUST modify the code so that it will not delete the time slices.
# temporary files can be quite large rmtree(gmt_temp) #rmtree(png_dir) |
*below is a example if you just want to plot specific ts without producing the movie file.
* you will need at least 10 time slices for the document
pool = mp.Pool(processes)
#pool.map(render_slice, xrange(xyts.t0, xyts.nt - xyts.t0))
pool.map(render_slice, [120,330,550,700,800,910,1000,1200,1500,1600])
print('FINISHED TIMESLICE SEGMENT IN %.2fs' % (time() - ts0))
print('AVERAGE TIMESLICE TIME %.2fs' % \
((time() - ts0) / (xyts.nt - xyts.t0)))
# images -> animation
#make_movie('%s/ts%%04d.png' % (png_dir), \
# os.path.join(base_dir, 'animation.mov'), fps = 20)
# temporary files can be quite large
rmtree(gmt_temp)
#rmtree(png_dir) |
plot_ts_sum.py
plot_ts_sum.py |
note: this step requires observation generated, please follow the wiki page referring How to create observation files
1.Create (or copy from template) a config file: post-processing_config.cfg
[files] outputDirectory = /home/nesi00213/RealTime/YYYYMMDD_EVENT_NAME_mXpX_YYYYMMDDHHmm/GM/Validation/ srfFile = /home/nesi00213/RealTime/YYYYMMDD_EVENT_NAME_mXpX_YYYYMMDDHHmm/Src/Model/YYYYMMDD_EVENT_NAME_mXpX/t2/Ian02_s103245.srf stationFile = /home/nesi00213/RealTime/YYYYMMDD_EVENT_NAME_mXpX_YYYYMMDDHHmm/Stat/YYYYMMDD_EVENT_NAME_mXpX/YYYYMMDD_EVENT_NAME_mXpX.ll velSimDir = /home/nesi00213/RealTime/YYYYMMDD_EVENT_NAME_mXpX_YYYYMMDDHHmm/GM/Sim/Data/BB/Vel/ dbLocation = /home/nesi00213/RealTime/YYYYMMDD_EVENT_NAME_mXpX_YYYYMMDDHHmm/GM/Validation/database.db siteClassFile = /nesi/projects/nesi00213/Pre-processing/RegionalSeismicityTectonics/Sept42010GmMetadata.ll vs30File = /home/nesi00213/RealTime/YYYYMMDD_EVENT_NAME_mXpX_YYYYMMDDHHmm/Stat/YYYYMMDD_EVENT_NAME_mXpX/YYYYMMDD_EVENT_NAME_mXpX.vs30 velObsDir = /home/nesi00213/RealTime/RealTimeYYYYMMDD_EVENT_NAME_mXpX_YYYYMMDDHHmm/GM/Obs/Data/velBB runName = RealTimeYYYYMMDD_EVENT_NAME_mXpX_YYYYMMDDHHmm [plotGMPE] DistMin = 1.0 DistMax = 100 nval = 51 vs30Default = 250.0, rake = ERROR:PLEASE_SET Rtvz = 0 Mw = ERROR:PLEASE_SET Ztor = ERROR:PLEASE_SET model = 1 dip = ERROR:PLEASE_SET [plotSeismogram] normalize = True magnify = 3.0 [calcIM] plotGMPE = True recalculateGMPE = False recalculateIMs = False calculateRRups = True calcIM = 3 [plotTimeSeries] gapStations = 5 nLimit = 5 tmax = 200 stationsToPlot = [] subdir = waveforms gapObsSim = 2 [plotIM] ImName = PGA,pSA,PGV,Ds575,Ds595,AI,CAV pSAStations = [] pSAPlotCommonAxisLimits = False unknown = D pSAPeriod = 0.1,0.2,0.5,1.0,3.0,10.0 siteClassMarkers = False |
2.Edit all the file directory to the correct folder. – it will error if you don't change all of the paths above.
3a) If you are running a RealTime simulation:
python /home/nesi00213/post-processing/examples/run_default_plots.py path_to_config_file
python /home/nesi00213/post-processing/examples/run_documentation_plots.py /home/nesi00213/RealTime/20161213_Kaikoura_m7p8_201705301501/GM/Validation/post-processing_config.cfg |
3b) If you are running a future event simulation:
python /home/nesi00213/post-processing/examples/run_simulation_plots.py path_to_config_file
python /home/nesi00213/post-processing/examples/run_simulation_plots.py /home/nesi00213/RealTime/20161213_Kaikoura_m7p8_201705301501/GM/Validation/post-processing_config.cfg |
* important: must edit the stationsToPlot if simulation used non-uniform grid. Otherwise it will plot all the virtual stations
* for future events, which mean there is not observation data
note:this must be done after post-processing
1.cd GM/Validation/Data. There should exist two .ll files PGV and pSA
2.plot the files using plot_stations.py
plot_stations.py stat_ratios_PGV_20161213_Amberley_m7p8_201705301501.ll [path_to_output_directory_optional] plot_stations.py stat_ratios_pSA_20161213_Amberley_m7p8_201705301501.ll [path_to_output_directory_optional] |
Note: new formate of config will have IM instead of PGV, 6 file instead of 1. pick the first one and ignore the rest.
create of copy the config file: publish.cfg
[event] title:13 Nov 2016 Mw7.8 Kaikoura location:/home/nesi00213/RealTime/20161213_Amberley_m7p8_201705301501 csv:/home/nesi00213/RealTime/20161213_Amberley_m7p8_201705301501/GM/Sim/MetaData output: 20161213_Amberley_m7p8_201705301501 [image] SrfMapView:Src/Figures/source_map.png srfSlipRiseTimeRake:Src/Figures/source_square.png # Vs30StationMap:VM/Figures/Vs30StationMap.png ObsTimeSeriesOnMap:GM/Obs/Figures/ObsTimeSeriesOnMap.png # timesliceLocation:GM/Sim/Figures/PNG_timeslices/ timesliceFiles:ts0120.png,ts0330.png,ts0550.png,ts0700.png,ts0800.png,ts0910.png,ts1000.png,ts1200.png,ts1500.png validationLocation:GM/Validation/Figures/IM/IM_vs_source_site_distance/ validationFiles:PGA_comp_geom_with_Rrup_with_GMPE_with_Station_ClassesVel.png,pSA(0p2)_comp_geom_with_Rrup_with_GMPE_20161213_Amberley_m7p8_201705301501.png,pSA(0p5)_comp_geom_with_Rrup_with_GMPE_20161213_Amberley_m7p8_201705301501.png,pSA(1)_comp_geom_with_Rrup_with_GMPE_20161213_Amberley_m7p8_201705301501.png,pSA(3)_comp_geom_with_Rrup_with_GMPE_20161213_Amberley_m7p8_201705301501.png,pSA(10)_comp_geom_with_Rrup_with_GMPE_20161213_Amberley_m7p8_201705301501.png pSAWithPeriod:GM/Validation/Figures/IM/spectra_ratio/pSAWithPeriod_compgeom_20161213_Amberley_m7p8_201705301501.png #missing spatialLocation:GM/Validation/Figures/ratios spatialFiles:PGV/p000.png,pSA/p000.png,pSA/p001.png,pSA/p002.png,pSA/p003.png,pSA/p004.png # simPgv:GM/Sim/Figures/PNG_tssum/PGV.png simMmi:GM/Sim/Figures/PNG_tssum/MMI.png # responseSpectraLocation:GM/Validation/Figures/IM/PSA responseSpectraFiles:pSA_comp_geom_vs_Period_Vel_AMBC.png,pSA_comp_geom_vs_Period_Vel_CMHS.png,pSA_comp_geom_vs_Period_Vel_DALS.png,pSA_comp_geom_vs_Period_Vel_FTPS.png,pSA_comp_geom_vs_Period_Vel_GLWS.png,pSA_comp_geom_vs_Period_Vel_INGS.png,pSA_comp_geom_vs_Period_Vel_KOWC.png,pSA_comp_geom_vs_Period_Vel_MCAS.png,pSA_comp_geom_vs_Period_Vel_NCBS.png,pSA_comp_geom_vs_Period_Vel_WVFS.png # waveformLocation:GM/Validation/Figures/waveforms waveformFiles:velts_ADCSAKSSAMBCAPPSARKS_2016Nov13_Ian02_s103245_VMCant_Amberly_200m-h0p200_EMODv3p0p4_161221.png,velts_SMTCSOCSSOMSSPRSSTAS_2016Nov13_Ian02_s103245_VMCant_Amberly_200m-h0p200_EMODv3p0p4_161221.png |
Run the publish script
python /home/nesi00213/gm_publish/publish.py publish.cfg |