Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This page summarizes the archiving of some of the current CyberShake results.

v17p9

Aka the first batch of faults for the South Island. This version was archived on the RCC legacy storage in a very naive way. Every fault was saved in a single tar file. Thus every tar file has all the realizations, and for each realization we have a LF, HF and BB. This archived version needs to be cleaned to reduce the file size and have easier access to the waveforms.

v18p4

This is the batch that completes all the inland faults on the South Island. Note that both results need to be aggregated to have everything. To archive this version, we decided that we would zip the three components of the waveform for a given location into a single file (this means we will have as many .zip files as locations in the simulation). The way this was archived is very simple as it can be shown in the following block:

Code Block
wdl16@dev01-quakecore:/rcc/home/projects/quakecore/cybershake/v18p4$ tree -L 4
.
├── IMs
│   └── database.db
├── metadata.json
└── Runs
    ├── AhuririR
    │   ├── AhuririR_HYP01-03_S1244
    │   │   ├── Acc
    │   │   ├── Vel
    │   │   └── xyts
    .....
    ├── Akatore
    │   ├── Akatore_HYP01-04_S1244
    │   │   ├── Acc
    │   │   ├── Vel
    │   │   └── xyts
    .....

This means that every fault has the realizations. For each realization we have an Acc, Vel and xyts directories, where I copied the zipped accelerations, zipped velocities and e3d files respectively. There is also a simple metadata.json file and the IM database for that particular version is archived. The metadata file has the following contents:

Code Block
{
    CyberShakeVersion : 'v18p4',
    Path : '/rcc/home/projects/quakecore/cybershake/v18p4',
    AccPath : '/rcc/home/projects/quakecore/cybershake/v18p4/Runs/*/*/Acc',
    VelPath : '/rcc/home/projects/quakecore/cybershake/v18p4/Runs/*/*/Vel',
    HasXYTS : 'yes',
    XYTSPath ; '/rcc/home/projects/quakecore/cybershake/v18p4/Runs/*/*/xyts',
    WaveFormSize : '423GB',
    SizePlusXYTS : '475GB',
    WaveFormCompression : 'zip'
    IMDBSize : '8.2GB',
    FaultNumber : 107,
    Description : 'Rest of South Island faults. v17p9 + v18p4 are all the faults on the SI'
}

This file was generated manually, but it should be automatically generated by the archiving process.

v18p5

This version completes the NZ faults by adding the North Island faults. This is the next archiving to be done, and it will follow the same structure as v18p4.

TODO

  • Add symbolic links to v18p4 to give the impression that it is actually v17p9 + more faults. The same will be needed for v18p5.

Future

...



SourceVM (.cfgs)BBIM
20p9Dropbox (.csv/.info)Dropbox

/nesi/nobackup/nesi00213/archive/Cybershake

Upload to Dropbox in progress


20p6(=20p4_200)Same as 20p4

Dropbox

Isilon: /isilon/cybershake/v20p4/200m_vmcf

/nesi/nobackup/nesi00213/archive/Cybershake

to be uploaded to Dropbox

IM_calc – Dropbox
20p5Dropbox (.csv/.info) Dropbox

/nesi/nobackup/nesi00213/archive/Cybershake

to be uploaded to Dropbox


20p4

Dropbox (.csv/.info)

Isilon: /isilon/cybershake/v20p4/Sources (full)

Dropbox

/isilon/cybershake/v20p4

/nesi/nobackup/nesi00213/archive/Cybershake

to be uploaded to Dropbox


19p5

Full Srf/Stoch

v19p5_sources – Dropbox

Dropbox (vm_params)

/nesi/nobackup/nesi00213/archive/Cybershake

Upload to Dropbox in progress


18p6

Full Srf/Stoch

v18p6_sources – Dropbox

Dropbox

Nearline

/nesi/nearline/nesi00213/RunFolder/to_nearline_18p6/v18p6_waveform_backup.tar

(Can't retrieve from it)

Dropbox (IMDB.h5)
18p5

Isilon: /isilon/cybershake/v18p5
18p4

Isilon: /isilon/cybershake/v18p4
17p9

Isilon: /isilon/cybershake/v17p9

 

...