Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

JobKupeFitz speed-up
Emod3d14342.43
Post-emod3d0.0166666670.424
HF0.54.28.4
BB0.141410
 14.679.65.45

Further testing

To test the scalability, we did another test performed a run on a much larger model (Cant Feb_February 2011 ), where: by Hoby). This model has nx=1400,ny=1200,nz=460.

The following results come from the LF calculation using EMOD3D for this model. The matrix below shows the relations of Cores and mean time used for each 100 iterations.

Requested coresPhysical coresNprocCPU(phys)Nodestime_per_100iterMean time for 100 time steps
8080290.3
128802129.6
16080297.47
160160446.2
256160465.5
320160448.6

We will note that Kupe is using hyper-threading by default. If we request N nodes, the best performance will be given by 40*N cores, anything above it seems to penalize the execution time.

Based on the matrix above, we did and estimation of the full run time on Cant 2011 earthquake(with sim_duration=100.0),   and obtain the matrixobtaining

 CPUtimeseccore _seccore_hourshours for the LF part of the simulation
Kupe16002:30:0092001472000408.88888888899
Fitz51201:50:0066003379200938.66666666677
Speedup    2.29565217393