linux上でfioを用いてIOPSを計測

IOPSが計測したい、と思いつき、調べてみるとfioというツールで簡単に計測出来るらしい。

というわけで計測してみた。

手元のCloudNで。OSはCent6.3。

fioはyumでinstall可能。

設定ファイルを作成し、引数で指定して実行する。

---write.fio---
[global]
ioengine=libaio
direct=1
invalidate=1
group_reporting
directory=/home
filename=test.bin
runtime=60

[Rand-Write-4k-qd32]
readwrite=randwrite
size=4G
bs=4k
iodepth=32
numjobs=1

書き込み性能の計測。
> fio write.fio

Rand-Write-4k-qd32: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=32
fio-2.0.13
Starting 1 process
Rand-Write-4k-qd32: Laying out IO file(s) (1 file(s) / 4096MB)
Jobs: 1 (f=1): [w] [1.6% done] [0K/1036K/0K /s] [0 /259 /0  iops] [eta 01h:04m:23s]
Rand-Write-4k-qd32: (groupid=0, jobs=1): err= 0: pid=6399: Fri Jun  6 16:47:56 2014
  write: io=65324KB, bw=1087.5KB/s, iops=271 , runt= 60069msec
    slat (usec): min=9 , max=147169 , avg=83.39, stdev=2505.22
    clat (usec): min=901 , max=319079 , avg=117614.32, stdev=60605.75
     lat (usec): min=939 , max=319103 , avg=117698.36, stdev=60659.33
    clat percentiles (msec):
     |  1.00th=[   16],  5.00th=[   26], 10.00th=[   37], 20.00th=[   56],
     | 30.00th=[   75], 40.00th=[   97], 50.00th=[  120], 60.00th=[  139],
     | 70.00th=[  157], 80.00th=[  176], 90.00th=[  198], 95.00th=[  212],
     | 99.00th=[  251], 99.50th=[  265], 99.90th=[  293], 99.95th=[  306],
     | 99.99th=[  318]
    bw (KB/s)  : min=  631, max= 1466, per=100.00%, avg=1090.50, stdev=189.22
    lat (usec) : 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.05%, 10=0.06%, 20=2.65%, 50=14.48%
    lat (msec) : 100=23.94%, 250=57.78%, 500=1.03%
  cpu          : usr=0.16%, sys=0.75%, ctx=6276, majf=0, minf=22
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=99.8%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=16331/d=0, short=r=0/w=0/d=0
Run status group 0 (all jobs):
  WRITE: io=65324KB, aggrb=1087KB/s, minb=1087KB/s, maxb=1087KB/s, mint=60069msec, maxt=60069msec
Disk stats (read/write):
    dm-0: ios=0/17652, merge=0/0, ticks=0/2025293, in_queue=2030659, util=99.92%, aggrios=0/16405, aggrmerge=0/1259, aggrticks=0/1913289, aggrin_queue=1913280, aggrutil=99.89%
  vda: ios=0/16405, merge=0/1259, ticks=0/1913289, in_queue=1913280, util=99.89%


書き込みIOPS271。

続いて読み込み。

----read.fio----
[global]
ioengine=libaio
direct=1
invalidate=1
group_reporting
directory=/home
filename=test.bin
runtime=60
[Rand-Read-4k-qd32]
readwrite=randread
size=4G
bs=4k
iodepth=32
numjobs=1


>fio read.fio

Rand-Read-4k-qd32: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=32
fio-2.0.13
Starting 1 process
Jobs: 1 (f=1): [r] [83.3% done] [773.6M/0K/0K /s] [198K/0 /0  iops] [eta 00m:02s]
Rand-Read-4k-qd32: (groupid=0, jobs=1): err= 0: pid=6416: Fri Jun  6 16:53:21 2014
  read : io=4096.0MB, bw=425256KB/s, iops=106314 , runt=  9863msec
    slat (usec): min=2 , max=441 , avg= 3.41, stdev= 3.71
    clat (usec): min=0 , max=109809 , avg=296.16, stdev=1518.26
     lat (usec): min=4 , max=109820 , avg=299.88, stdev=1520.24
    clat percentiles (usec):
     |  1.00th=[  137],  5.00th=[  139], 10.00th=[  141], 20.00th=[  143],
     | 30.00th=[  147], 40.00th=[  153], 50.00th=[  157], 60.00th=[  157],
     | 70.00th=[  159], 80.00th=[  167], 90.00th=[  177], 95.00th=[  181],
     | 99.00th=[ 4640], 99.50th=[ 9280], 99.90th=[24448], 99.95th=[30592],
     | 99.99th=[42240]
    bw (KB/s)  : min= 9940, max=840800, per=96.25%, avg=409291.58, stdev=392536.90
    lat (usec) : 2=0.01%, 10=0.02%, 20=0.01%, 50=0.01%, 100=0.03%
    lat (usec) : 250=98.17%, 500=0.19%, 750=0.02%, 1000=0.01%
    lat (msec) : 2=0.04%, 4=0.38%, 10=0.67%, 20=0.28%, 50=0.17%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=14.73%, sys=44.41%, ctx=10779, majf=0, minf=56
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
     issued    : total=r=1048576/w=0/d=0, short=r=0/w=0/d=0
Run status group 0 (all jobs):
   READ: io=4096.0MB, aggrb=425256KB/s, minb=425256KB/s, maxb=425256KB/s, mint=9863msec, maxt=9863msec
Disk stats (read/write):
    dm-0: ios=16331/10, merge=0/0, ticks=149442/415, in_queue=149857, util=48.35%, aggrios=16331/4, aggrmerge=0/7, aggrticks=149418/114, aggrin_queue=149521, aggrutil=47.25%
  vda: ios=16331/4, merge=0/7, ticks=149418/114, in_queue=149521, util=47.25%


10万・・・？