config 如下
# This job file tries to mimic the Intel IOMeter File Server Access Pattern
[global]
description=Emulation of Intel IOmeter File Server Access Pattern
[iometer]
bssplit=512/10:1k/5:2k/5:4k/60:8k/2:16k/4:32k/4:64k/10
filename=\\.\PhysicalDrive1:\\.\PhysicalDrive2:\\.\PhysicalDrive3
size=1G
rw=randrw
#set read 50% write 50%
rwmixread=50
direct=1
runtime=60
# IOMeter defines the server loads as the following:
# iodepth=1 Linear
# iodepth=4 Very Light
# iodepth=8 Light
# iodepth=64 Moderate
# iodepth=256 Heavy
iodepth=64
[global]
description=Emulation of Intel IOmeter File Server Access Pattern
[iometer]
bssplit=512/10:1k/5:2k/5:4k/60:8k/2:16k/4:32k/4:64k/10
filename=\\.\PhysicalDrive1:\\.\PhysicalDrive2:\\.\PhysicalDrive3
size=1G
rw=randrw
#set read 50% write 50%
rwmixread=50
direct=1
runtime=60
# IOMeter defines the server loads as the following:
# iodepth=1 Linear
# iodepth=4 Very Light
# iodepth=8 Light
# iodepth=64 Moderate
# iodepth=256 Heavy
iodepth=64
4個模式結果如下
default no cache
iometer: (g=0): rw=randrw, bs=(R) 512B-64.0KiB, (W) 512B-64.0KiB, (T) 512B-64.0KiB, ioengine=psync, iodepth=64
fio-3.7
Starting 1 process
iometer: Laying out IO files (3 files / total 1023MiB)
Jobs: 1 (f=3): [m(1)][100.0%][r=12.1MiB/s,w=12.3MiB/s][r=2912,w=2900 IOPS][eta 00m:00s]
iometer: (groupid=0, jobs=1): err= 0: pid=1059: Sun Oct 24 21:59:29 2021
Description : [Emulation of Intel IOmeter File Server Access Pattern]
read: IOPS=2643, BW=15.0MiB/s (16.7MB/s)(518MiB/32459msec)
clat (usec): min=98, max=3023, avg=151.62, stdev=52.08
lat (usec): min=100, max=3025, avg=153.64, stdev=52.78
clat percentiles (usec):
| 1.00th=[ 108], 5.00th=[ 113], 10.00th=[ 116], 20.00th=[ 120],
| 30.00th=[ 124], 40.00th=[ 129], 50.00th=[ 137], 60.00th=[ 145],
| 70.00th=[ 153], 80.00th=[ 167], 90.00th=[ 217], 95.00th=[ 262],
| 99.00th=[ 326], 99.50th=[ 367], 99.90th=[ 498], 99.95th=[ 644],
| 99.99th=[ 1074]
bw ( KiB/s): min= 17, max=29187, per=100.00%, avg=16368.95, stdev=5319.54, samples=64
iops : min= 6, max= 3237, avg=2636.11, stdev=553.54, samples=64
write: IOPS=2632, BW=15.6MiB/s (16.4MB/s)(506MiB/32459msec)
clat (usec): min=109, max=269781, avg=208.42, stdev=1809.64
lat (usec): min=111, max=269787, avg=210.60, stdev=1809.68
clat percentiles (usec):
| 1.00th=[ 117], 5.00th=[ 122], 10.00th=[ 126], 20.00th=[ 131],
| 30.00th=[ 137], 40.00th=[ 141], 50.00th=[ 151], 60.00th=[ 159],
| 70.00th=[ 167], 80.00th=[ 182], 90.00th=[ 233], 95.00th=[ 277],
| 99.00th=[ 343], 99.50th=[ 388], 99.90th=[13435], 99.95th=[32637],
| 99.99th=[77071]
bw ( KiB/s): min= 25, max=27107, per=100.00%, avg=16004.09, stdev=5117.56, samples=64
iops : min= 8, max= 3423, avg=2627.02, stdev=552.46, samples=64
lat (usec) : 100=0.01%, 250=93.02%, 500=6.83%, 750=0.06%, 1000=0.02%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.03%
lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%
cpu : usr=4.79%, sys=12.52%, ctx=171263, majf=0, minf=36
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=85804,85461,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=15.0MiB/s (16.7MB/s), 15.0MiB/s-15.0MiB/s (16.7MB/s-16.7MB/s), io=518MiB (543MB), run=32459-32459msec
WRITE: bw=15.6MiB/s (16.4MB/s), 15.6MiB/s-15.6MiB/s (16.4MB/s-16.4MB/s), io=506MiB (531MB), run=32459-32459msec
Disk stats (read/write):
vda: ios=85701/85498, merge=0/34, ticks=11506/17166, in_queue=28672, util=99.78%
===================================================================
direct sync
iometer: (g=0): rw=randrw, bs=(R) 512B-64.0KiB, (W) 512B-64.0KiB, (T) 512B-64.0KiB, ioengine=psync, iodepth=64
fio-3.7
Starting 1 process
Jobs: 1 (f=3): [m(1)][100.0%][r=9873KiB/s,w=9.85MiB/s][r=2326,w=2311 IOPS][eta 00m:00s]
iometer: (groupid=0, jobs=1): err= 0: pid=1024: Sun Oct 24 22:01:57 2021
Description : [Emulation of Intel IOmeter File Server Access Pattern]
read: IOPS=2588, BW=15.6MiB/s (16.4MB/s)(518MiB/33143msec)
clat (usec): min=101, max=2854, avg=153.73, stdev=51.58
lat (usec): min=103, max=2855, avg=155.67, stdev=52.05
clat percentiles (usec):
| 1.00th=[ 109], 5.00th=[ 115], 10.00th=[ 118], 20.00th=[ 123],
| 30.00th=[ 126], 40.00th=[ 133], 50.00th=[ 141], 60.00th=[ 147],
| 70.00th=[ 155], 80.00th=[ 169], 90.00th=[ 215], 95.00th=[ 260],
| 99.00th=[ 334], 99.50th=[ 375], 99.90th=[ 519], 99.95th=[ 660],
| 99.99th=[ 1045]
bw ( KiB/s): min= 8901, max=29142, per=100.00%, avg=16021.95, stdev=4651.25, samples=66
iops : min= 1870, max= 3118, avg=2589.53, stdev=300.89, samples=66
write: IOPS=2578, BW=15.3MiB/s (16.0MB/s)(506MiB/33143msec)
clat (usec): min=119, max=123840, avg=214.82, stdev=1482.62
lat (usec): min=121, max=123842, avg=216.99, stdev=1482.65
clat percentiles (usec):
| 1.00th=[ 127], 5.00th=[ 133], 10.00th=[ 137], 20.00th=[ 143],
| 30.00th=[ 147], 40.00th=[ 153], 50.00th=[ 163], 60.00th=[ 174],
| 70.00th=[ 182], 80.00th=[ 194], 90.00th=[ 241], 95.00th=[ 289],
| 99.00th=[ 367], 99.50th=[ 424], 99.90th=[ 5866], 99.95th=[29492],
| 99.99th=[80217]
bw ( KiB/s): min= 9162, max=26677, per=100.00%, avg=15655.61, stdev=4532.61, samples=66
iops : min= 1860, max= 3100, avg=2577.86, stdev=315.86, samples=66
lat (usec) : 250=92.52%, 500=7.29%, 750=0.10%, 1000=0.02%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.02%
lat (msec) : 100=0.01%, 250=0.01%
cpu : usr=4.74%, sys=11.81%, ctx=171269, majf=0, minf=36
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=85804,85461,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=15.6MiB/s (16.4MB/s), 15.6MiB/s-15.6MiB/s (16.4MB/s-16.4MB/s), io=518MiB (543MB), run=33143-33143msec
WRITE: bw=15.3MiB/s (16.0MB/s), 15.3MiB/s-15.3MiB/s (16.0MB/s-16.0MB/s), io=506MiB (531MB), run=33143-33143msec
Disk stats (read/write):
vda: ios=85795/85513, merge=0/20, ticks=11798/16745, in_queue=28543, util=99.74%
===============================================================
write through
iometer: (g=0): rw=randrw, bs=(R) 512B-64.0KiB, (W) 512B-64.0KiB, (T) 512B-64.0KiB, ioengine=psync, iodepth=64
fio-3.7
Starting 1 process
Jobs: 1 (f=3): [m(1)][100.0%][r=13.8MiB/s,w=14.2MiB/s][r=3275,w=3321 IOPS][eta 00m:00s]
iometer: (groupid=0, jobs=1): err= 0: pid=1025: Sun Oct 24 22:03:47 2021
Description : [Emulation of Intel IOmeter File Server Access Pattern]
read: IOPS=2467, BW=14.9MiB/s (15.6MB/s)(518MiB/34776msec)
clat (usec): min=28, max=2270, avg=105.88, stdev=76.86
lat (usec): min=30, max=2272, avg=107.86, stdev=77.07
clat percentiles (usec):
| 1.00th=[ 35], 5.00th=[ 36], 10.00th=[ 37], 20.00th=[ 38],
| 30.00th=[ 40], 40.00th=[ 43], 50.00th=[ 81], 60.00th=[ 135],
| 70.00th=[ 151], 80.00th=[ 165], 90.00th=[ 194], 95.00th=[ 241],
| 99.00th=[ 330], 99.50th=[ 371], 99.90th=[ 482], 99.95th=[ 570],
| 99.99th=[ 971]
bw ( KiB/s): min= 9946, max=20245, per=99.96%, avg=15240.57, stdev=2279.39, samples=69
iops : min= 1582, max= 3690, avg=2457.10, stdev=587.94, samples=69
write: IOPS=2457, BW=14.6MiB/s (15.3MB/s)(506MiB/34776msec)
clat (usec): min=135, max=78912, avg=281.99, stdev=1239.11
lat (usec): min=136, max=78913, avg=284.13, stdev=1239.15
clat percentiles (usec):
| 1.00th=[ 147], 5.00th=[ 151], 10.00th=[ 157], 20.00th=[ 165],
| 30.00th=[ 178], 40.00th=[ 192], 50.00th=[ 210], 60.00th=[ 245],
| 70.00th=[ 285], 80.00th=[ 330], 90.00th=[ 375], 95.00th=[ 424],
| 99.00th=[ 570], 99.50th=[ 644], 99.90th=[ 9110], 99.95th=[28443],
| 99.99th=[63177]
bw ( KiB/s): min= 9128, max=20043, per=99.95%, avg=14897.84, stdev=2082.27, samples=69
iops : min= 1570, max= 3638, avg=2447.70, stdev=574.29, samples=69
lat (usec) : 50=23.06%, 100=2.41%, 250=53.12%, 500=20.28%, 750=0.99%
lat (usec) : 1000=0.06%
lat (msec) : 2=0.02%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.02%
lat (msec) : 100=0.01%
cpu : usr=4.38%, sys=11.16%, ctx=171251, majf=0, minf=36
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=85804,85461,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=14.9MiB/s (15.6MB/s), 14.9MiB/s-14.9MiB/s (15.6MB/s-15.6MB/s), io=518MiB (543MB), run=34776-34776msec
WRITE: bw=14.6MiB/s (15.3MB/s), 14.6MiB/s-14.6MiB/s (15.3MB/s-15.3MB/s), io=506MiB (531MB), run=34776-34776msec
Disk stats (read/write):
vda: ios=85360/85041, merge=0/18, ticks=7406/22572, in_queue=29978, util=99.75%
================================================================
write back
iometer: (g=0): rw=randrw, bs=(R) 512B-64.0KiB, (W) 512B-64.0KiB, (T) 512B-64.0KiB, ioengine=psync, iodepth=64
fio-3.7
Starting 1 process
Jobs: 1 (f=3): [m(1)][100.0%][r=29.4MiB/s,w=29.9MiB/s][r=6976,w=7009 IOPS][eta 00m:00s]
iometer: (groupid=0, jobs=1): err= 0: pid=1021: Sun Oct 24 22:05:06 2021
Description : [Emulation of Intel IOmeter File Server Access Pattern]
read: IOPS=3871, BW=23.4MiB/s (24.5MB/s)(518MiB/22164msec)
clat (usec): min=28, max=12350, avg=112.79, stdev=135.36
lat (usec): min=30, max=12352, avg=114.83, stdev=135.55
clat percentiles (usec):
| 1.00th=[ 35], 5.00th=[ 37], 10.00th=[ 38], 20.00th=[ 41],
| 30.00th=[ 43], 40.00th=[ 46], 50.00th=[ 69], 60.00th=[ 139],
| 70.00th=[ 157], 80.00th=[ 178], 90.00th=[ 212], 95.00th=[ 262],
| 99.00th=[ 363], 99.50th=[ 412], 99.90th=[ 603], 99.95th=[ 938],
| 99.99th=[ 5342]
bw ( KiB/s): min=10682, max=31639, per=100.00%, avg=23930.39, stdev=4126.10, samples=44
iops : min= 2212, max= 7366, avg=3861.02, stdev=1436.84, samples=44
write: IOPS=3855, BW=22.8MiB/s (23.9MB/s)(506MiB/22164msec)
clat (usec): min=36, max=203000, avg=126.42, stdev=930.79
lat (usec): min=38, max=203002, avg=128.86, stdev=930.84
clat percentiles (usec):
| 1.00th=[ 44], 5.00th=[ 47], 10.00th=[ 49], 20.00th=[ 52],
| 30.00th=[ 55], 40.00th=[ 58], 50.00th=[ 62], 60.00th=[ 97],
| 70.00th=[ 153], 80.00th=[ 215], 90.00th=[ 258], 95.00th=[ 285],
| 99.00th=[ 388], 99.50th=[ 441], 99.90th=[ 693], 99.95th=[ 1221],
| 99.99th=[15270]
bw ( KiB/s): min=10302, max=32041, per=100.00%, avg=23399.55, stdev=4090.09, samples=44
iops : min= 2148, max= 7414, avg=3846.48, stdev=1417.26, samples=44
lat (usec) : 50=28.96%, 100=27.75%, 250=34.74%, 500=8.33%, 750=0.15%
lat (usec) : 1000=0.02%
lat (msec) : 2=0.02%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
lat (msec) : 250=0.01%
cpu : usr=7.40%, sys=17.75%, ctx=171252, majf=0, minf=36
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=85804,85461,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=23.4MiB/s (24.5MB/s), 23.4MiB/s-23.4MiB/s (24.5MB/s-24.5MB/s), io=518MiB (543MB), run=22164-22164msec
WRITE: bw=22.8MiB/s (23.9MB/s), 22.8MiB/s-22.8MiB/s (23.9MB/s-23.9MB/s), io=506MiB (531MB), run=22164-22164msec
Disk stats (read/write):
vda: ios=85645/85340, merge=0/17, ticks=8026/10446, in_queue=18472, util=99.52%
前三個模式沒有太大的差異
但 write back 效能不管是讀或寫
都快了 1.5倍以上
做為參考
沒有留言:
張貼留言