Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The above needs to be fixed.

 

Results

All tasks complete.

Hurdles/Changes/Summary

  • xarray which was going to be used for storage was not fit for purpose as many to many relationship resulted in wasted space across multiple dimensions.
  • sqlite database had to be implemented to combat above issue, cs18p6 resulted in about 24GiB of space (1.5hrs) which takes ~1min to retrieve all IMs/GMs for quite a common station.
  • no intermediate file (mainly repeated inputs from first step anyway), just pass a few arrays to the second step.
  • text file at the end kept for now but simpler/minimal/more elegant as end users may not be comfortable using alternatives.

Considerations

  • DB retrieval for station slow (~1min, cs18.6), should internally loop im_levels/values to prevent re-querying when plugging into seisfinder.