You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 37 Next »

Structure of Codebase 

(from SW Codebase page : This page is somewhat outdated, but contains some useful background)

Repository Specific Improvements

RepoImprovementNote

slurm_gm_workflow

https://github.com/ucgmsim/slurm_gm_workflow

 

Outstanding issues

  • DB Issue: Fix the lock issue caused by excessive access
  • Remove/update legacy code & parameters and accomodate new environment
  • Deprecate cybershake.json

Improvements

  • Separate repos: workflow automation vs calculation
  • Better logging
  • Automated verification/testing
  • Integrate model (srf/vm) into the workflow (with an option to stop before simulation)
  • Estimation performance optimization
  • Automated Visualisation
  • Error handling
  • Realisation name change: AlpineF2K_HYP01-47_S1244 to AlpineF2K_REL01
  • Site-specific binary workflow

qcore


https://github.com/ucgmsim/qcore

Remove unneeded code/functions

More coherent structure with related functions kept in the same file

Consistent comment styles using doctoring and API doc

Expand automated unit test coverage (less than 10%)

(lat.lon).csv → grid.xml currently not used. Plan for PAGER?


Pre-processing
https://github.com/ucgmsim/Pre-processing

 

Better estimation for model generation

Repo restructure : GMSim_model, NonUniformGrid and archive unused legacy code

Incorporate model generation into management DB (See slurm_gm_workflow)

Automated testing for model generation

NonUniformGrid code has minor issues (but low priority, run yearly)


seisfinder (ver.1/ver.2)

https://github.com/ucgmsim/seisfinder2

Regression tests (after scientific validation)

GM selection

Login and user management

Missing ver.1 features:

  • validation document (using gm_publish)
  • custom name
  • PGV map (upon the selection of an event)
  • All im .csv files into one .csv



Visualisation

https://github.com/ucgmsim/visualization

Clean up

Python 3

Refactor plot_stations.py


empirical_engine

https://github.com/ucgmsim/Empirical_Engine

Integrate into hazard workflow (replacing OpenPSHA, no new functionality, but can streamline empdb creation)


ground failure

https://github.com/ucgmsim/GroundFailure

Clean up

validation

https://github.com/ucgmsim/validation

Mixed effect regression workflow to be version-controlled

Add automation

Improve the code quality


GMSimViz

https://github.com/ucgmsim/GMSimViz

 

Specifying regions of interest

gm_publish

https://github.com/ucgmsim/gm_publish

Decide if seisfinder2 needs this

IM_calculation

https://github.com/ucgmsim/IM_calculation

Include just .000 and .090 for geom only (33% speed up)

Calculate RTVZ and RX

Replace Cython spectra with better Python code


Velocity_Model

https://github.com/ucgmsim/Velocity-Model

-

EMOD3D

https://github.com/ucgmsim/EMOD3D

-


Common Improvements

  • Template for README : Amalgamate README, Codebase wiki page and repo maturity page, and put everything in README.
  • Python 3 and coding & comment style
  • Automated testing and Continuous integration

Stable Release

A repository that satisfies the following criteria will have an official stable release.

  • All the planned functionalities have been developed and tested
  • Codebase has been cleaned up
  • Good comments & documentation (README)
  • Automated testing coverage over 80%

The repositories we should aim to produce stable releases are (ordered by impact/risk analysis)

  • IM_calculation
  • Pre-processing
  • Qcore
  • Slurm_gm_workflow 



Plan for Q2: Mid April - End of June

  1. Stable release of IM_calc and Pre-processing repos : Initially small team of 2~3 piloting, polishing up the process
  2. Slurm_gm_workflow & Qcore restructuring
  3. Completing all features for SeisFinder2 
  4. README template : 
  5. Standard for comment and API doc : Numpy style
  6. New features








  • No labels