Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • DB retrieval for station slow (~1min, cs18p6), should internally loop im_levels/values to prevent re-querying when plugging into seisfinder. Alternatively retrieve more data at once.
  • Want to use DB for other things? Multiprocessing to load CSV files (bottleneck), store more data (station rrup, lon/lat, realisations vs fault etc.).

Replacing IM_agg CSV files

IMDB already contains the data in CSV files so instead of reading CSV files, we get the data from IMDB making the IM_agg data obsolete.

Timing results (Mahuika)

  • Using IM_agg CSV files to retrieve 1 IM for 1 station: ~80 seconds
  • Using IMDB to cache all IMs (22) for 1 station: ~60 seconds
  • Using IMDB to cache 1 IM for 1 station: ~50 seconds
  • Loading IMDB cache: < 1 second