Job Meta Data
| params | Location | Note |
|---|---|---|
| Slurm Job ID | to make it unique, may need to be combined with submission time. | |
| RunGroupName | ||
| Submission time | ||
| Start time (of the first task) | ||
| End time (of the last task) | ||
| Wall clock | ||
| Number of cores requested | ||
Number of nodes requested | ||
| Memory requested | ||
| Partition | ||
| Machine | ||
| System load | Availability unknown |
Task Meta Data
| params | LF step | HF step | BB step | Location | Note |
|---|---|---|---|---|---|
| Slurm Job ID | |||||
| Task ID | Step.Realisation.Timestamp | ||||
| Run time (in hours) | sim_dir/ch_log | ||||
| Cores used | sim_dir/ch_log | ||||
| Memory used per Core | sim_dir/LF/srf/Rlog/*.rlog see note 3 & 4. | ||||
| Nx | sim_dir/ch_log, params_base.py | ||||
| Ny | sim_dir/ch_log, params_base.py | ||||
| Nz | sim_dir/ch_log, params_base.py | ||||
| hh | params_base.py | ||||
| nt | sim_dir/ch_log, params.py | ||||
| dt | params_base.py | ||||
| nsub_stoch | sim_dir/ch_log | ||||
| fd_count (station number) | sim_dir/ch_log | ||||
| start, end, submission time | ??? |
Notes:
- Columns in green at the parameters that is currently known that is affecting Run time.
- For any parameters that can be retrieved from ch_log, they can be collected by other means; see into proc.sl.template for reference.
- The Rlog stores the "estimated" memory usage not the actual used.
- Rlogs for LF are stored in ASCII format. everything should be human readable. the work load of each core is recorded at the start of the log. (size, dt, nt, hh, mem)
- The location of 'start, end, submission time' is currently unknown and will be collected later.
...