...
if you wish to view all jobs you submitted
Code Block llq -u username -f %jn %id %st
this will show all jobs "username" submitted (with the job name, jobid, and job status)
the script below can be used to parallel download files using rsync.
!!! the folder tree must first be created using.Code Block -av -f"+ */" -f"- *" $source_dir $des_dir
!!! must be modified. its using 'find' to return a list of folders, and parse it to download_rsync using 'xargs -o -n1 -P$threadnumber'
Code Block find LF -type d -print0 | xargs -0 -n1 -P12 -I% ~/gm_sim_workflow/devel/cybershake/download_rsyn.sh ykh22@fitzroy.nesi.org.nz:/nesi/projects/nesi00213/RunFolder/Cybershake/v17p9/Runs/AlpineF2K/% /nesi/projects/nesi00213/RunFolder/Cybershake/17p9/backup/AlpineF2K/LF
TODO:
- add script to auto test all simulations and submit the next step
- (currently need to run the test script and submit the next step manually)
- A script to adjust WCT for HF
- currently HF has a hard-coded/static WCT
- (multiple re-submission of HF is needed if the boundary is large, more than 7 times for Alpine simulations)
- A script to check if a job is still running(or in queue)
- currently user needs to manually check that
- a script to bulk check may help automating
- 2Make a script to automate the parallel download script.