Overview


Duration: 29 Apr - 10 May (10 days) 

completedin progresson holdto do
405315

(vs record 61 completed sprint 19)


Observations

  1. Recovery from Easter break
  2. No BB at planning meeting
  3. A number of out-of-scope tasks


Epic
Story
Owner
Deliverables
Link
Validation

NeSI issue

Produce LF-only/HF-only written plan (decide what BB features are required)

[Timeseries] Enable LF to output Acceleration ascii files

Added distributions and updated Documentation


Broken compute node suspected : Apparently fixed.





Task Management Refactor Plan

Added distributions

Cybershake

HF issues with HikWelMax,HikRauk (will revisit after new SRF gen or larger dx/dy in Stoch)

Stoch File with 2km (will revisit with new SRFGen(RG))


Subduction cybershake (v19p4) from NZFM (just subduction-interface)

  • Magnitude Scaling for subduction interface/slab faults

  • SRF validation for 5.4.2 (Shallow Crustal & subduction)
    • 50 srf - Single Fault (any) : check stats for consistency - 4 cases

In progress

Run GMSimViz (Hik)

Jason













Cybershake v19p5
Slurm Workflow
  • Remove Cybershake configuration file (.json)
  • Change HYP01 → REL01 in generation / post process 
    code
  • Reduce the sim duration to 60~75% (Check with BB)
  • Auto submit logging
  • Plan Submission of SRF / VM on a realisation by realisation  level
  • Remove outdated workflow from NHM2SRF
  1. James
  2. James
  3. Jason
  4. James
  5. Jason
  1. Most cybershake config file parameters in root_defaults
  2. Done
  3. Done
  4. Logging added, PR pending
4. Automated workflow logging
SeisFinder

Testing/Verification

  • Produce benchmark output from the current code
  • Code refactor to make it suitable for unit-tests + implement unit tests
  • Karim to verify the output

Ground motion integration

Plan user management features

Misc. items for webpage

ACC timeseries displayed chart, downloadable as zip with no temporary files (direct to browser, instant)

Viktor / Claudio / Daniel

1) Created hazard and empdb benchmark
2) Removed unused code
2) Refactored site_search_hazard.py and create_imdb.py


Out of scope: AWS: S3 utilised for static data storage (DB, waveform etc) (2.5cents per Gb: 5 times cheaper than standard EBS storage).

SeisFinder Test & Release Plan
Test
  1. e2e_test for source generation
  2. e23_test add check for metadata logging
  3. estimation unit test
  4. GMSim multi version support in e2e_test
  5. e2e (workflow) validation test

Claudio

Melody

1) Todo
2) Todo (minor)
3) Done
5) Minor fixes to workflow, updates to e2e test code to handle large number of simulations, complete successful run through 627 validation sim – Done (although severally delayed by HF issue)

GMSim Version parameter removed from cybershake_config and added to e2e_test_config
Ground failure

No active tasks (waiting for Liam/Amelia's feedback)

James/Jason



IM_Calc
  • Only calculating geom component upon request to improve performance by 50%
  • Updated unit testing
  • Vahid's integration for Advanced IMs

Jason

Melody



Dashboard

Feature extension for allocation period:

  • dropdown & text inputs for custom allocation period
  • total user core hours usage over a specific allocation period

Bug fix:

  • Extended timeout period for ssh cmd


Jason

Claudio

Melody

Donehttp://hypocentre:8050/
Bug fixes

Remove duplicate params_vel.yaml

ll2xy doesn't consider rotation when generating fd_station list


  1. James
  2. Jonney


  1.  Done
  2. Wild goose chase

Misc

1. Check disk utilisation (eg. Check why we have millions of files on HPC) - Ideally schedule every 6month.

2. Ensure SRF corners are within VM domain

3. BB estimation fix (edge case)

4. Script to copy hf_seed file between different cybershake Runs

5. ERF plot

6. Rx source code OpenSHA

7.

  1. Jason
  2. James
  3. Claudio
  4. Melody
  5. Viktor
  6. Claudio
  7. Jason
  1. File count reduced by 1.5M
  2. Validate VM modified
  3. Todo (minor)
  4. Done
  5. Hazard Curves / Deagg for Karim to investigate. So we can finish the CS paper.



 



  • No labels