...
The above needs to be fixed.
Results
All tasks complete.
Hurdles/Changes/Summary
- xarray which was going to be used for storage was not fit for purpose as many to many relationship resulted in wasted space across multiple dimensions.
- sqlite database had to be implemented to combat above issue, cs18p6 resulted in about 24GiB of space (1.5hrs) which takes ~1min to retrieve all IMs/GMs for quite a common station.
- no intermediate file (mainly repeated inputs from first step anyway), just pass a few arrays to the second step.
- text file at the end kept for now but simpler/minimal/more elegant as end users may not be comfortable using alternatives.
Considerations
- DB retrieval for station slow (~1min, cs18.6), should internally loop im_levels/values to prevent re-querying when plugging into seisfinder.