KnowHow

技術的なメモを中心にまとめます。
検索にて調べることができます。

CPU実行時間を確認するコマンド

登録日 :2026/01/18 20:07
カテゴリ :SLURM

SLURMのCPU実行時間を見るには、以下のコマンド。
CPU時間はステップ時間を全て合算する必要があるので、jobID.*で表示されるものを全て集約してあげる必要がある

#!/bin/bash

starttime=2026-01-01

#sacct --starttime $starttime --endtime now --format=JobID%5,end%16,User%8,JobName%8,Partition%8,Nodelist%10,NCPU%5,AllocTRES%35,elapsed,CPUTime,TotalCPU,UserCPU,state -X
sacct --starttime $starttime --endtime now --format=JobID%10,end%16,User%8,JobName%8,Partition%8,Nodelist%10,NCPU%5,AllocTRES%35,elapsed,CPUTime,TotalCPU,UserCPU,SystemCPU,state

実行例

[root@rx8manage TOOLS]# mysacct
     JobID              End     User  JobName Partitio   NodeList NCPUS                           AllocTRES    Elapsed    CPUTime   TotalCPU    UserCPU  SystemCPU      State 
---------- ---------------- -------- -------- -------- ---------- ----- ----------------------------------- ---------- ---------- ---------- ---------- ---------- ---------- 
         1 2026-01-18T08:43   user01    test1    part1  rx8node01     1              billing=1,cpu=1,node=1   00:01:01   00:01:01   00:00:00   00:00:00   00:00:00  COMPLETED 
   1.batch 2026-01-18T08:43             batch           rx8node01     1                  cpu=1,mem=0,node=1   00:01:01   00:01:01   00:00:00   00:00:00   00:00:00  COMPLETED 
         2 2026-01-18T08:44   user01    test1    part1  rx8node01     1              billing=1,cpu=1,node=1   00:01:00   00:01:00   00:00:00   00:00:00   00:00:00  COMPLETED 
   2.batch 2026-01-18T08:44             batch           rx8node01     1                  cpu=1,mem=0,node=1   00:01:00   00:01:00   00:00:00   00:00:00   00:00:00  COMPLETED 
         3 2026-01-18T09:57   user01    test1    part1  rx8node01     1   billing=1,cpu=1,gres/gpu=2,node=1   00:01:01   00:01:01  00:00.054  00:00.054   00:00:00  COMPLETED 
   3.batch 2026-01-18T09:57             batch           rx8node01     1       cpu=1,gres/gpu=2,mem=0,node=1   00:01:01   00:01:01  00:00.054  00:00.054   00:00:00  COMPLETED 
         4 2026-01-18T11:45   user01    test1    part1  rx8node01     1              billing=1,cpu=1,node=1   00:00:01   00:00:01  00:00.046  00:00.034  00:00.011     FAILED 
   4.batch 2026-01-18T11:45             batch           rx8node01     1                  cpu=1,mem=0,node=1   00:00:01   00:00:01  00:00.046  00:00.034  00:00.011     FAILED 
         5 2026-01-18T11:47   user01    test1    part1  rx8node01     1              billing=1,cpu=1,node=1   00:00:10   00:00:10  00:00.225  00:00.147  00:00.078  COMPLETED 
   5.batch 2026-01-18T11:47             batch           rx8node01     1                  cpu=1,mem=0,node=1   00:00:10   00:00:10  00:00.225  00:00.147  00:00.078  COMPLETED 
         6 2026-01-18T11:52   user01    test1    part1  rx8node01     1              billing=1,cpu=1,node=1   00:00:01   00:00:01  00:00.197  00:00.133  00:00.063     FAILED 
   6.batch 2026-01-18T11:52             batch           rx8node01     1                  cpu=1,mem=0,node=1   00:00:01   00:00:01  00:00.197  00:00.133  00:00.063     FAILED 
         7 2026-01-18T11:53   user01    test1    part1  rx8node01     1              billing=1,cpu=1,node=1   00:00:11   00:00:11  00:07.626  00:07.455  00:00.171  COMPLETED 
   7.batch 2026-01-18T11:53             batch           rx8node01     1                  cpu=1,mem=0,node=1   00:00:11   00:00:11  00:07.626  00:07.455  00:00.171  COMPLETED 
         8 2026-01-18T11:56   user01    test1    part1  rx8node01     1              billing=1,cpu=1,node=1   00:01:01   00:01:01  00:58.667  00:58.511  00:00.155  COMPLETED 
   8.batch 2026-01-18T11:56             batch           rx8node01     1                  cpu=1,mem=0,node=1   00:01:01   00:01:01  00:58.667  00:58.511  00:00.155  COMPLETED 
         9 2026-01-18T12:01   user01    test1    part1  rx8node01     1              billing=1,cpu=1,node=1   00:01:01   00:01:01  00:43.052  00:42.761  00:00.291  COMPLETED 
   9.batch 2026-01-18T12:01             batch           rx8node01     1                  cpu=1,mem=0,node=1   00:01:01   00:01:01  00:43.052  00:42.761  00:00.291  COMPLETED 
        10 2026-01-18T17:55   user01    test1    part1  rx8node01     1              billing=1,cpu=1,node=1   00:02:02   00:02:02  01:12.834  01:12.203  00:00.630  COMPLETED 
  10.batch 2026-01-18T17:55             batch           rx8node01     1                  cpu=1,mem=0,node=1   00:02:02   00:02:02  01:12.834  01:12.203  00:00.630  COMPLETED 
        11 2026-01-18T17:59   user01    test1    part1  rx8node01     1              billing=1,cpu=1,node=1   00:02:01   00:02:01  00:00.365  00:00.275  00:00.089  COMPLETED 
  11.batch 2026-01-18T17:59             batch           rx8node01     1                  cpu=1,mem=0,node=1   00:02:01   00:02:01  00:00.365  00:00.275  00:00.089  COMPLETED 
        12 2026-01-18T18:05   user01    test1    part1  rx8node01     1              billing=1,cpu=1,node=1   00:02:02   00:02:02  00:00.232  00:00.158  00:00.073  COMPLETED 
  12.batch 2026-01-18T18:05             batch           rx8node01     1                  cpu=1,mem=0,node=1   00:02:02   00:02:02  00:00.232  00:00.158  00:00.073  COMPLETED 
        13 2026-01-18T18:11   user01    test1    part1  rx8node01     1              billing=1,cpu=1,node=1   00:02:01   00:02:01  01:40.639  01:40.392  00:00.246  COMPLETED 
  13.batch 2026-01-18T18:11             batch           rx8node01     1                  cpu=1,mem=0,node=1   00:02:01   00:02:01  01:40.639  01:40.392  00:00.246  COMPLETED 

表示が見づらかったので

[root@rx8manage TOOLS]# sacct --starttime 2026-01-01 --endtime now --format=JobID%10,elapsed,CPUTime,TotalCPU,UserCPU,SystemCPU,state
     JobID    Elapsed    CPUTime   TotalCPU    UserCPU  SystemCPU      State 
---------- ---------- ---------- ---------- ---------- ---------- ---------- 
         1   00:01:01   00:01:01   00:00:00   00:00:00   00:00:00  COMPLETED 
   1.batch   00:01:01   00:01:01   00:00:00   00:00:00   00:00:00  COMPLETED 
         2   00:01:00   00:01:00   00:00:00   00:00:00   00:00:00  COMPLETED 
   2.batch   00:01:00   00:01:00   00:00:00   00:00:00   00:00:00  COMPLETED 
         3   00:01:01   00:01:01  00:00.054  00:00.054   00:00:00  COMPLETED 
   3.batch   00:01:01   00:01:01  00:00.054  00:00.054   00:00:00  COMPLETED 
         4   00:00:01   00:00:01  00:00.046  00:00.034  00:00.011     FAILED 
   4.batch   00:00:01   00:00:01  00:00.046  00:00.034  00:00.011     FAILED 
         5   00:00:10   00:00:10  00:00.225  00:00.147  00:00.078  COMPLETED 
   5.batch   00:00:10   00:00:10  00:00.225  00:00.147  00:00.078  COMPLETED 
         6   00:00:01   00:00:01  00:00.197  00:00.133  00:00.063     FAILED 
   6.batch   00:00:01   00:00:01  00:00.197  00:00.133  00:00.063     FAILED 
         7   00:00:11   00:00:11  00:07.626  00:07.455  00:00.171  COMPLETED 
   7.batch   00:00:11   00:00:11  00:07.626  00:07.455  00:00.171  COMPLETED 
         8   00:01:01   00:01:01  00:58.667  00:58.511  00:00.155  COMPLETED 
   8.batch   00:01:01   00:01:01  00:58.667  00:58.511  00:00.155  COMPLETED 
         9   00:01:01   00:01:01  00:43.052  00:42.761  00:00.291  COMPLETED 
   9.batch   00:01:01   00:01:01  00:43.052  00:42.761  00:00.291  COMPLETED 
        10   00:02:02   00:02:02  01:12.834  01:12.203  00:00.630  COMPLETED 
  10.batch   00:02:02   00:02:02  01:12.834  01:12.203  00:00.630  COMPLETED 
        11   00:02:01   00:02:01  00:00.365  00:00.275  00:00.089  COMPLETED 
  11.batch   00:02:01   00:02:01  00:00.365  00:00.275  00:00.089  COMPLETED 
        12   00:02:02   00:02:02  00:00.232  00:00.158  00:00.073  COMPLETED 
  12.batch   00:02:02   00:02:02  00:00.232  00:00.158  00:00.073  COMPLETED 
        13   00:02:01   00:02:01  01:40.639  01:40.392  00:00.246  COMPLETED 
  13.batch   00:02:01   00:02:01  01:40.639  01:40.392  00:00.246  COMPLETED 
[root@rx8manage TOOLS]#