Functions:
- Detect anomalies in the IMs produced by a GM simulation with respect a benchmark (either empirical or a previous CS)
- Investigation and Visualization of GM simulations to allow identifying interesting science (and improvements made wrt. earlier versions)
Components:
- Generation of Comparison IM CSVs (fault based)
- From empirical GMMs
- From previous GM simulation runs
- Implementation of residual metrics (and other investigation metrics?)
- At individual simulation level
- At fault level
- Per Site
- At Run/CS level
- Fault Level
- Scripts for result checking directly after completion (i.e. integrated into workflow as a job?)
- At Rel Level
- At Fault Level
- Visualization
- Spatial Residuals maps
- At Rel Level
- At Fault Level
- Reference IM Plots
- At Rel Level
- At Fault Level
- Summary Spatial Residual Plots (i.e. histogram)
- At Rel level
- At Fault level
- Single Site
- Residual distribution (i.e. histogram)
- At Fault Level
- Response spectra comparison
- At Rel Level
- At Fault Level
- Residual distribution (i.e. histogram)
- Response Spectra Means
- Across all Sites
- At Cybershake Level (one line per event)
- Across all Cybershake Events
- At each Site (one line per site)
- Across all Sites
- Spatial Mean Log Ratio across Events run for each Site
- At Cybershake Level
- Spatial Residuals maps
Structure / Overview
https://github.com/ucgmsim/cybershake_investigation
Base directory (cybershake_investigation)
- cybershake_investigation
- configs (Holds config files for acceptable station difference values)
- scripts (Contains scripts to call functionality)
- compare_csvs (Script to compare IMs from empirical models to cybershake results)
- gen_empirical (Script to generate empirical data for a cybershake_root structure, has different args to archived version)
- gen_empirical_archive (Script to generate empirical data for archived versions of cybershake)
- plot_avg_event_residual_spectra (Script to produce a single plot across all events at every site across the response spectrum)
- plot_avg_site_residual (Script to produce a single plot across all sites for every event across the response spectrum)
- plot_avg_site_residual_spectra (Script to produce a single plot that shows the log ratio residuals values across the NZ map for every event / site)
- plot_hist_residual (Script that shows the ratio value data in a histogram instead of a map view for each fault and or realisation)
- plot_single_site_residual (Script to plot a histogram of a single site / fault / IM showing each realisation ratio value)
- plot_single_site_spectrum (Script to plot pSA values for averaged simulation / empirical values and shows each realisation in grey lines for a single site / fault)
- plot_spatial_im (Script that plots the IM values directly for each IM / fault and or realisation on a map)
- plot_spatial_residual (Script that plots the ratio values between empirical and simulation for each fault and or realisation)
- empirical (Contains the functions to calculate empirical values for archived or cybershake run results)
- _spectra (Contains the functions to plot response spectra with all events and sites)
- hist (Contains the functions to plot all histogram plots)
- ratios (Contains the function to compute the ratios between simulation and empirical results and test against acceptable station difference values)
- single_site (Contains the functions to plot single site residual histograms and pSA values)
- spatial (Contains the function to plot spatially the IM, ratio values and also a histogram of those spatial values)
- utils (Contains common functions used by multiple different scripts)
- Readme, setup, requirements, jenkinsfile etc.