CPU実行時間を確認するコマンド
| 登録日 | :2026/01/18 20:07 |
|---|---|
| カテゴリ | :SLURM |
SLURMのCPU実行時間を見るには、以下のコマンド。
CPU時間はステップ時間を全て合算する必要があるので、jobID.*で表示されるものを全て集約してあげる必要がある
#!/bin/bash
starttime=2026-01-01
#sacct --starttime $starttime --endtime now --format=JobID%5,end%16,User%8,JobName%8,Partition%8,Nodelist%10,NCPU%5,AllocTRES%35,elapsed,CPUTime,TotalCPU,UserCPU,state -X
sacct --starttime $starttime --endtime now --format=JobID%10,end%16,User%8,JobName%8,Partition%8,Nodelist%10,NCPU%5,AllocTRES%35,elapsed,CPUTime,TotalCPU,UserCPU,SystemCPU,state
実行例
[root@rx8manage TOOLS]# mysacct
JobID End User JobName Partitio NodeList NCPUS AllocTRES Elapsed CPUTime TotalCPU UserCPU SystemCPU State
---------- ---------------- -------- -------- -------- ---------- ----- ----------------------------------- ---------- ---------- ---------- ---------- ---------- ----------
1 2026-01-18T08:43 user01 test1 part1 rx8node01 1 billing=1,cpu=1,node=1 00:01:01 00:01:01 00:00:00 00:00:00 00:00:00 COMPLETED
1.batch 2026-01-18T08:43 batch rx8node01 1 cpu=1,mem=0,node=1 00:01:01 00:01:01 00:00:00 00:00:00 00:00:00 COMPLETED
2 2026-01-18T08:44 user01 test1 part1 rx8node01 1 billing=1,cpu=1,node=1 00:01:00 00:01:00 00:00:00 00:00:00 00:00:00 COMPLETED
2.batch 2026-01-18T08:44 batch rx8node01 1 cpu=1,mem=0,node=1 00:01:00 00:01:00 00:00:00 00:00:00 00:00:00 COMPLETED
3 2026-01-18T09:57 user01 test1 part1 rx8node01 1 billing=1,cpu=1,gres/gpu=2,node=1 00:01:01 00:01:01 00:00.054 00:00.054 00:00:00 COMPLETED
3.batch 2026-01-18T09:57 batch rx8node01 1 cpu=1,gres/gpu=2,mem=0,node=1 00:01:01 00:01:01 00:00.054 00:00.054 00:00:00 COMPLETED
4 2026-01-18T11:45 user01 test1 part1 rx8node01 1 billing=1,cpu=1,node=1 00:00:01 00:00:01 00:00.046 00:00.034 00:00.011 FAILED
4.batch 2026-01-18T11:45 batch rx8node01 1 cpu=1,mem=0,node=1 00:00:01 00:00:01 00:00.046 00:00.034 00:00.011 FAILED
5 2026-01-18T11:47 user01 test1 part1 rx8node01 1 billing=1,cpu=1,node=1 00:00:10 00:00:10 00:00.225 00:00.147 00:00.078 COMPLETED
5.batch 2026-01-18T11:47 batch rx8node01 1 cpu=1,mem=0,node=1 00:00:10 00:00:10 00:00.225 00:00.147 00:00.078 COMPLETED
6 2026-01-18T11:52 user01 test1 part1 rx8node01 1 billing=1,cpu=1,node=1 00:00:01 00:00:01 00:00.197 00:00.133 00:00.063 FAILED
6.batch 2026-01-18T11:52 batch rx8node01 1 cpu=1,mem=0,node=1 00:00:01 00:00:01 00:00.197 00:00.133 00:00.063 FAILED
7 2026-01-18T11:53 user01 test1 part1 rx8node01 1 billing=1,cpu=1,node=1 00:00:11 00:00:11 00:07.626 00:07.455 00:00.171 COMPLETED
7.batch 2026-01-18T11:53 batch rx8node01 1 cpu=1,mem=0,node=1 00:00:11 00:00:11 00:07.626 00:07.455 00:00.171 COMPLETED
8 2026-01-18T11:56 user01 test1 part1 rx8node01 1 billing=1,cpu=1,node=1 00:01:01 00:01:01 00:58.667 00:58.511 00:00.155 COMPLETED
8.batch 2026-01-18T11:56 batch rx8node01 1 cpu=1,mem=0,node=1 00:01:01 00:01:01 00:58.667 00:58.511 00:00.155 COMPLETED
9 2026-01-18T12:01 user01 test1 part1 rx8node01 1 billing=1,cpu=1,node=1 00:01:01 00:01:01 00:43.052 00:42.761 00:00.291 COMPLETED
9.batch 2026-01-18T12:01 batch rx8node01 1 cpu=1,mem=0,node=1 00:01:01 00:01:01 00:43.052 00:42.761 00:00.291 COMPLETED
10 2026-01-18T17:55 user01 test1 part1 rx8node01 1 billing=1,cpu=1,node=1 00:02:02 00:02:02 01:12.834 01:12.203 00:00.630 COMPLETED
10.batch 2026-01-18T17:55 batch rx8node01 1 cpu=1,mem=0,node=1 00:02:02 00:02:02 01:12.834 01:12.203 00:00.630 COMPLETED
11 2026-01-18T17:59 user01 test1 part1 rx8node01 1 billing=1,cpu=1,node=1 00:02:01 00:02:01 00:00.365 00:00.275 00:00.089 COMPLETED
11.batch 2026-01-18T17:59 batch rx8node01 1 cpu=1,mem=0,node=1 00:02:01 00:02:01 00:00.365 00:00.275 00:00.089 COMPLETED
12 2026-01-18T18:05 user01 test1 part1 rx8node01 1 billing=1,cpu=1,node=1 00:02:02 00:02:02 00:00.232 00:00.158 00:00.073 COMPLETED
12.batch 2026-01-18T18:05 batch rx8node01 1 cpu=1,mem=0,node=1 00:02:02 00:02:02 00:00.232 00:00.158 00:00.073 COMPLETED
13 2026-01-18T18:11 user01 test1 part1 rx8node01 1 billing=1,cpu=1,node=1 00:02:01 00:02:01 01:40.639 01:40.392 00:00.246 COMPLETED
13.batch 2026-01-18T18:11 batch rx8node01 1 cpu=1,mem=0,node=1 00:02:01 00:02:01 01:40.639 01:40.392 00:00.246 COMPLETED
表示が見づらかったので
[root@rx8manage TOOLS]# sacct --starttime 2026-01-01 --endtime now --format=JobID%10,elapsed,CPUTime,TotalCPU,UserCPU,SystemCPU,state
JobID Elapsed CPUTime TotalCPU UserCPU SystemCPU State
---------- ---------- ---------- ---------- ---------- ---------- ----------
1 00:01:01 00:01:01 00:00:00 00:00:00 00:00:00 COMPLETED
1.batch 00:01:01 00:01:01 00:00:00 00:00:00 00:00:00 COMPLETED
2 00:01:00 00:01:00 00:00:00 00:00:00 00:00:00 COMPLETED
2.batch 00:01:00 00:01:00 00:00:00 00:00:00 00:00:00 COMPLETED
3 00:01:01 00:01:01 00:00.054 00:00.054 00:00:00 COMPLETED
3.batch 00:01:01 00:01:01 00:00.054 00:00.054 00:00:00 COMPLETED
4 00:00:01 00:00:01 00:00.046 00:00.034 00:00.011 FAILED
4.batch 00:00:01 00:00:01 00:00.046 00:00.034 00:00.011 FAILED
5 00:00:10 00:00:10 00:00.225 00:00.147 00:00.078 COMPLETED
5.batch 00:00:10 00:00:10 00:00.225 00:00.147 00:00.078 COMPLETED
6 00:00:01 00:00:01 00:00.197 00:00.133 00:00.063 FAILED
6.batch 00:00:01 00:00:01 00:00.197 00:00.133 00:00.063 FAILED
7 00:00:11 00:00:11 00:07.626 00:07.455 00:00.171 COMPLETED
7.batch 00:00:11 00:00:11 00:07.626 00:07.455 00:00.171 COMPLETED
8 00:01:01 00:01:01 00:58.667 00:58.511 00:00.155 COMPLETED
8.batch 00:01:01 00:01:01 00:58.667 00:58.511 00:00.155 COMPLETED
9 00:01:01 00:01:01 00:43.052 00:42.761 00:00.291 COMPLETED
9.batch 00:01:01 00:01:01 00:43.052 00:42.761 00:00.291 COMPLETED
10 00:02:02 00:02:02 01:12.834 01:12.203 00:00.630 COMPLETED
10.batch 00:02:02 00:02:02 01:12.834 01:12.203 00:00.630 COMPLETED
11 00:02:01 00:02:01 00:00.365 00:00.275 00:00.089 COMPLETED
11.batch 00:02:01 00:02:01 00:00.365 00:00.275 00:00.089 COMPLETED
12 00:02:02 00:02:02 00:00.232 00:00.158 00:00.073 COMPLETED
12.batch 00:02:02 00:02:02 00:00.232 00:00.158 00:00.073 COMPLETED
13 00:02:01 00:02:01 01:40.639 01:40.392 00:00.246 COMPLETED
13.batch 00:02:01 00:02:01 01:40.639 01:40.392 00:00.246 COMPLETED
[root@rx8manage TOOLS]#