...
- DB retrieval for station slow (~1min, cs18p6), should internally loop im_levels/values to prevent re-querying when plugging into seisfinder. Alternatively retrieve more data at once.
- Want to use DB for other things? Multiprocessing to load CSV files (bottleneck), store more data (station rrup, lon/lat, realisations vs fault etc.).
Replacing IM_agg CSV files
IMDB already contains the data in CSV files so instead of reading CSV files, we get the data from IMDB making the IM_agg data obsolete.
Timing results (Mahuika)
- Using IM_agg CSV files to retrieve 1 IM for 1 station: ~80 seconds
- Using IMDB to cache all IMs (22) for 1 station: ~60 seconds
- Using IMDB to cache 1 IM for 1 station: ~50 seconds
- Loading IMDB cache: < 1 second