Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • if you wish to view all jobs you submitted

    Code Block
    llq -u username -f %jn %id %st

    this will show all jobs "username" submitted (with the job name, jobid, and job status)

  • the script below can be used to parallel download files using rsync.
    !!! the folder tree must first be created using.

    Code Block
    -av -f"+ */" -f"- *" $source_dir $des_dir

    !!! must be modified. its using 'find' to return a list of folders, and parse it to download_rsync using 'xargs  -o -n1 -P$threadnumber'

    Code Block
    find LF -type d -print0 | xargs -0 -n1 -P12 -I% ~/gm_sim_workflow/devel/cybershake/download_rsyn.sh ykh22@fitzroy.nesi.org.nz:/nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/AlpineF2K/% /nesi/projects/nesi00213/RunFolder/Cybershake/17p9/backup/AlpineF2K/LF


TODO:

  • add script to auto test all simulations and submit the next step
    • (currently need to run the test script and submit the next step manually)
  • A script to adjust WCT for HF
    • currently HF has a hard-coded/static WCT
    • (multiple re-submission of HF is needed if the boundary is large, more than 7 times for Alpine simulations)
  • A script to check if a job is still running(or in queue)
    • currently user needs to manually check that
    • a script to bulk check may help automating
  • 2Make a script to automate the parallel download script.