Overview

Duration:  18 May  - 29 May  

completedin progresson holdreviewto do
77



(vs record 77 completed sprint 50)


Epic
Story
OwnerDeliverables
Link
Validation

1) 400m Whole NZ validation run (tectonic classification)

2) Re-run advanced IMs

3) Assist Sarah with vs30 runs

1) Robin

2) Jonney

3) James

1) Underway

2) Started, not sure of the status. Vahid supplied new model

3) Done


Ground Motion DB

1) Ground Motion Extraction

2) Hikurangi Geometry

3) Tectonic Classification

4) Mw Reconciliation (comparison : John Ristau vs international dataset)


5) Comparison with VH2017

1)Viktor

2) James

3) Mike /  James

4) ?

5) ?

1) On hold until more progress with NoisePy

2) Some progress made. Still some issues though

3)(Mike? Robbin thinks it's stable)


Hikurangi surface geometry
Cybershake

1) Cybershake Subduction (8 faults) :

Complete BB after IM plot checks


2)Running 200m sims LF only - on Kisti / Maui (until Maui allocation leaves 100k)


  1. lower south island / all rels (KISTI)(Maui)
  2. Central South island / all rels (Maui)
  3. all faults/1 rel (KISTI) (Maui)
  4. remaining faults/all rels (KISTI)

4) Empirical DS - DB calculation

5) Empirical / Cybershake / ratio hazard maps

1)Jason


2) Sung

1) Subduction is complete

2) South and Central South island is completed. The remaining ~50 faults in the South Island have been installed and will run over first week of June. Then some quick validation of the south island before starting the NI. (on Maui) (500k on subscription and 500k on merit for remainder of CS 200 v20p6)

4) Checkpointing is being implemented. Have plans to reduce memory requirement but will need to investigate performance impact.

5) Waiting on DS / 200m SI for more plots. Subduction and Subduction + 400m maps were produced.

(Check Kisti/Stampede2 can handle memory requirements)


2)PBS

Slurm Workflow
  1. Generalize hacks for KISTI
  2. CH estimation based on linear regression
  3. Integrate with pre-processing (starting with VM)
    1. Separate db creation out of install
    2. Create generic slurm for the rest of install, make install operate on each fault
    3. Create a generic slurm for VM generation
  4. Pre-processing - GCMT to realisation – add some conditional logic about tectonic type (Brendon / Robin to consult about conditional parameters)

  1. James
  2. Jason / Brendon
  3. Jonney
  4. James

1) Deferred

2) Maui 400m CS data passed to Brendon

3) Deferred

4) Done: Subduction gcmt source srfs can be generated now



SeisTech
  1. GM Selection for Empirical
    1. Integrate workflow into seistech master
    2. Synthetic tests for GCIM between Empirical and Simulation (1 rupture, N ruptures)
    3. For Daniel: - what tasks for him to do?
    4. Testing, trial calculations
  2. Automate documentation
  3. Front-end
    1. Milestone #2
      1. authentication.
      2. user access to individual tab controlled by authentication
      3. User data managed by API, and additional user data kept in a separate db
      4. Data integrity and consistency between Auth0 and separate db maintained.
    2. Milestone #3
      1. API call framework - plan the API proxy
      2. Create Mock API's with canned JSON response
      3. Call mocked API from the front end and ingest JSON. To demonstrate an example of full functionality of the front end
    3. Milestone #4: API – 2
      1. Create an API proxy - including error messages for restricted access
      1. Call existing Core API’s from the front end replacing the mocks.
      2. JWT authorisation between the proxy and the core API
    1. Milestone #5: Deployment of 3 core environments
      1. Deploy DEV, TEST/EA, PROD versions
      2. Deployment is fully automated via scripts and config files.
      3. Update or switch-over is easily achieved utilizing deployment slots 
      4. Disruption is kept minimal when updated.

4) Empirical DS - DB calculation


  1. Daniel / Claudio
  2. Background task (Jason)
  3. Andy

1) a) Empirical core functionality added
b) Testing to be done once empirical GMS is also integrated

Roadmap (scientific functionality list)

Production - TODO (longer term tasks)

IM Calc





Bug fixes



Seismic risk



Machine Learning
  1. NN - GMM
    1. Implement an initial basic pipeline with some NN config + flexible feature selection & preprocessing
    2. Add hypo-depth to NN GMM dataset
  2. GM Classifier – see link


Claudio

1) Some additional visualization changes currently in progress
2) Validation iteration, identified a couple of scenarios where GMC is not struggling


Empirical engine



Vs30





Misc
  1. SimAtlas simulation+animation:
    1. Test auto workflow with batch 4. (total 100 faults)
    2. Once batch 4 is done. Keep fueling the fire
  2. Data management policy (classification of data importance.
  3. NoisePy
  4. NeSI allocation: Chat with NeSI, keep subscription allocation separate)
  5. Velocity Model basins
  1. Sung/Jonney
  2. Sung

2. Done :20Tb out of 120Tb deleted. Permission issues.

4) New allocations till end of August.

5) Tim and Cameron confirmed to work on Basin Modelling over semester break. Remote access for Move software available.

  • No labels