2016/05/17

最近因為實體機的wsus出問題
因此把她移到proxmox上
本來是想在win上mount nfs來用
但看來wsus並不支援
後來改用iscsi
但在kvm的硬碟效能看來並不好
想調看看
依據下面的文件做了一下測試
https://pve.proxmox.com/wiki/Performance_Tweaks

使用fio

四個mode的結果分別如下

no cache (proxmox預設)

iometer: (groupid=0, jobs=1): err= 0: pid=4376: Tue May 17 01:14:11 2016  Descri
ption  : [Emulation of Intel IOmeter File Server Access Pattern]
  read : io=839580KB, bw=986.43KB/s, iops=187, runt=851139msec
    slat (usec): min=33, max=12019, avg=135.28, stdev=127.09
    clat (usec): min=863, max=45860K, avg=272726.04, stdev=690206.66
     lat (msec): min=1, max=45860, avg=272.86, stdev=690.21
    clat percentiles (msec):
     |  1.00th=[   14],  5.00th=[   34], 10.00th=[   52], 20.00th=[   85],
     | 30.00th=[  119], 40.00th=[  155], 50.00th=[  198], 60.00th=[  249],
     | 70.00th=[  314], 80.00th=[  392], 90.00th=[  498], 95.00th=[  668],
     | 99.00th=[ 1237], 99.50th=[ 1418], 99.90th=[ 1958], 99.95th=[10683],
     | 99.99th=[16712]
    bw (KB  /s): min=    1, max= 3527, per=100.00%, avg=1031.92, stdev=539.62
  write: io=209006KB, bw=251453B/s, iops=47, runt=851139msec
    slat (usec): min=36, max=9979, avg=144.38, stdev=139.48
    clat (msec): min=1, max=42109, avg=268.91, stdev=674.52
     lat (msec): min=1, max=42109, avg=269.06, stdev=674.52
    clat percentiles (msec):
     |  1.00th=[   13],  5.00th=[   33], 10.00th=[   52], 20.00th=[   85],
     | 30.00th=[  117], 40.00th=[  153], 50.00th=[  194], 60.00th=[  247],
     | 70.00th=[  310], 80.00th=[  388], 90.00th=[  490], 95.00th=[  660],
     | 99.00th=[ 1221], 99.50th=[ 1434], 99.90th=[ 2008], 99.95th=[ 8717],
     | 99.99th=[16712]
    bw (KB  /s): min=    0, max=  976, per=100.00%, avg=257.99, stdev=155.70
    lat (usec) : 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.07%, 10=0.50%, 20=1.59%, 50=7.30%
    lat (msec) : 100=15.26%, 250=35.57%, 500=29.91%, 750=5.77%, 1000=1.93%
    lat (msec) : 2000=1.99%, >=2000=0.10%
  cpu          : usr=1.06%, sys=4.46%, ctx=0, majf=0, minf=0
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.7%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.1%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued    : total=r=159733/w=40419/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0

     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: io=839579KB, aggrb=986KB/s, minb=986KB/s, maxb=986KB/s, mint=851139msec
, maxt=851139msec
  WRITE: io=209005KB, aggrb=245KB/s, minb=245KB/s, maxb=245KB/s, mint=851139msec
, maxt=851139msec


direct sync

iometer: (groupid=0, jobs=1): err= 0: pid=3960: Tue May 17 01:34:28 2016  Descri
ption  : [Emulation of Intel IOmeter File Server Access Pattern]
  read : io=839580KB, bw=990904B/s, iops=184, runt=867621msec
    slat (usec): min=29, max=4295, avg=127.63, stdev=94.92
    clat (msec): min=1, max=3990, avg=278.10, stdev=248.29
     lat (msec): min=1, max=3990, avg=278.23, stdev=248.29
    clat percentiles (msec):
     |  1.00th=[   15],  5.00th=[   39], 10.00th=[   61], 20.00th=[   98],
     | 30.00th=[  135], 40.00th=[  176], 50.00th=[  219], 60.00th=[  265],
     | 70.00th=[  326], 80.00th=[  404], 90.00th=[  529], 95.00th=[  734],
     | 99.00th=[ 1303], 99.50th=[ 1516], 99.90th=[ 1860], 99.95th=[ 2008],
     | 99.99th=[ 2474]
    bw (KB  /s): min=  104, max= 3121, per=100.00%, avg=972.63, stdev=462.35
  write: io=209006KB, bw=246676B/s, iops=46, runt=867621msec
    slat (usec): min=33, max=3792, avg=137.96, stdev=101.21
    clat (msec): min=1, max=3267, avg=273.82, stdev=245.31
     lat (msec): min=1, max=3267, avg=273.95, stdev=245.31
    clat percentiles (msec):
     |  1.00th=[   14],  5.00th=[   37], 10.00th=[   59], 20.00th=[   95],
     | 30.00th=[  131], 40.00th=[  172], 50.00th=[  215], 60.00th=[  262],
     | 70.00th=[  322], 80.00th=[  396], 90.00th=[  523], 95.00th=[  734],
     | 99.00th=[ 1270], 99.50th=[ 1483], 99.90th=[ 1795], 99.95th=[ 1926],
     | 99.99th=[ 2376]
    bw (KB  /s): min=    1, max=  837, per=100.00%, avg=241.81, stdev=139.50
    lat (msec) : 2=0.01%, 4=0.06%, 10=0.43%, 20=1.28%, 50=5.89%
    lat (msec) : 100=13.20%, 250=36.27%, 500=31.53%, 750=6.52%, 1000=2.28%
    lat (msec) : 2000=2.48%, >=2000=0.05%
  cpu          : usr=0.58%, sys=4.26%, ctx=0, majf=0, minf=0
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued    : total=r=159733/w=40419/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0

     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: io=839579KB, aggrb=967KB/s, minb=967KB/s, maxb=967KB/s, mint=867621msec
, maxt=867621msec
  WRITE: io=209005KB, aggrb=240KB/s, minb=240KB/s, maxb=240KB/s, mint=867621msec
, maxt=867621msec

writethrough

iometer: (groupid=0, jobs=1): err= 0: pid=464: Tue May 17 01:44:14 2016  Descrip
tion  : [Emulation of Intel IOmeter File Server Access Pattern]
  read : io=839580KB, bw=2750.9KB/s, iops=523, runt=305208msec
    slat (usec): min=33, max=3381, avg=148.74, stdev=118.02
    clat (usec): min=525, max=3432.2K, avg=97497.21, stdev=190958.21
     lat (usec): min=608, max=3432.2K, avg=97645.95, stdev=190948.63
    clat percentiles (msec):
     |  1.00th=[    4],  5.00th=[    8], 10.00th=[   11], 20.00th=[   17],
     | 30.00th=[   22], 40.00th=[   28], 50.00th=[   35], 60.00th=[   42],
     | 70.00th=[   57], 80.00th=[   96], 90.00th=[  265], 95.00th=[  465],
     | 99.00th=[  996], 99.50th=[ 1287], 99.90th=[ 1713], 99.95th=[ 1844],
     | 99.99th=[ 2245]
    bw (KB  /s): min=  117, max=10905, per=100.00%, avg=2768.59, stdev=2650.18
  write: io=209006KB, bw=701232B/s, iops=132, runt=305208msec
    slat (usec): min=36, max=2704, avg=157.69, stdev=118.79
    clat (usec): min=643, max=2868.8K, avg=96528.89, stdev=185218.15
     lat (usec): min=730, max=2868.9K, avg=96686.58, stdev=185208.44
    clat percentiles (msec):
     |  1.00th=[    4],  5.00th=[    8], 10.00th=[   11], 20.00th=[   17],
     | 30.00th=[   22], 40.00th=[   28], 50.00th=[   35], 60.00th=[   42],
     | 70.00th=[   57], 80.00th=[   97], 90.00th=[  265], 95.00th=[  461],
     | 99.00th=[  963], 99.50th=[ 1221], 99.90th=[ 1631], 99.95th=[ 1778],
     | 99.99th=[ 2008]
    bw (KB  /s): min=    1, max= 3243, per=100.00%, avg=688.92, stdev=677.96
    lat (usec) : 750=0.01%, 1000=0.02%
    lat (msec) : 2=0.21%, 4=1.13%, 10=8.32%, 20=17.18%, 50=40.00%
    lat (msec) : 100=13.73%, 250=8.92%, 500=6.15%, 750=2.57%, 1000=0.79%
    lat (msec) : 2000=0.96%, >=2000=0.02%
  cpu          : usr=2.95%, sys=11.47%, ctx=0, majf=0, minf=0
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=22.4%, >=64=77.6%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=99.9%, 8=0.1%, 16=0.1%, 32=0.1%, 64=0.1%, >=64=0.0%
     issued    : total=r=159733/w=40419/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0

     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: io=839579KB, aggrb=2750KB/s, minb=2750KB/s, maxb=2750KB/s, mint=305208m
sec, maxt=305208msec
  WRITE: io=209005KB, aggrb=684KB/s, minb=684KB/s, maxb=684KB/s, mint=305208msec
, maxt=305208msec

writeback

iometer: (groupid=0, jobs=1): err= 0: pid=1904: Tue May 17 01:56:37 2016  Descri
ption  : [Emulation of Intel IOmeter File Server Access Pattern]
  read : io=839580KB, bw=2514.4KB/s, iops=478, runt=333921msec
    slat (usec): min=29, max=12023, avg=185.33, stdev=221.12
    clat (usec): min=538, max=13009K, avg=106457.27, stdev=193275.54
     lat (usec): min=670, max=13009K, avg=106642.60, stdev=193264.18
    clat percentiles (msec):
     |  1.00th=[    5],  5.00th=[    9], 10.00th=[   13], 20.00th=[   21],
     | 30.00th=[   29], 40.00th=[   38], 50.00th=[   48], 60.00th=[   68],
     | 70.00th=[   93], 80.00th=[  137], 90.00th=[  265], 95.00th=[  408],
     | 99.00th=[  783], 99.50th=[ 1156], 99.90th=[ 1795], 99.95th=[ 2024],
     | 99.99th=[ 4490]
    bw (KB  /s): min=   70, max=10009, per=100.00%, avg=2528.25, stdev=1930.08
  write: io=209006KB, bw=640934B/s, iops=121, runt=333921msec
    slat (usec): min=32, max=12301, avg=195.26, stdev=240.65
    clat (usec): min=637, max=10893K, avg=106044.70, stdev=199408.62
     lat (usec): min=699, max=10894K, avg=106239.95, stdev=199397.25
    clat percentiles (msec):
     |  1.00th=[    5],  5.00th=[    9], 10.00th=[   13], 20.00th=[   21],
     | 30.00th=[   29], 40.00th=[   38], 50.00th=[   48], 60.00th=[   68],
     | 70.00th=[   94], 80.00th=[  137], 90.00th=[  265], 95.00th=[  404],
     | 99.00th=[  742], 99.50th=[ 1106], 99.90th=[ 1811], 99.95th=[ 2008],
     | 99.99th=[ 7308]
    bw (KB  /s): min=    3, max= 2501, per=100.00%, avg=629.21, stdev=504.36
    lat (usec) : 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.14%, 4=0.75%, 10=5.70%, 20=12.30%, 50=32.48%
    lat (msec) : 100=20.56%, 250=17.35%, 500=7.78%, 750=1.87%, 1000=0.38%
    lat (msec) : 2000=0.62%, >=2000=0.06%
  cpu          : usr=2.10%, sys=12.88%, ctx=0, majf=0, minf=0
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=25.7%, >=64=74.3%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=99.8%, 8=0.2%, 16=0.1%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued    : total=r=159733/w=40419/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0

     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: io=839579KB, aggrb=2514KB/s, minb=2514KB/s, maxb=2514KB/s, mint=333921m
sec, maxt=333921msec
  WRITE: io=209005KB, aggrb=625KB/s, minb=625KB/s, maxb=625KB/s, mint=333921msec
, maxt=333921msec

單純看iops
writeback 和 writethrough 差不多

但文件上針對 writeback有這一句
Warn : you can loose datas in case of a powerfailure

所以看來 writethrough是比較好的選擇



沒有留言: