fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.5% done] [ 15273/  3828 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [16.0% done] [ 17553/  2863 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [20.0% done] [ 13678/  5301 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [24.0% done] [ 12662/  5179 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [26.9% done] [ 11827/  2634 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [29.6% done] [  6758/  9121 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [32.1% done] [ 13048/  2059 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [37.0% done] [  8960/  7160 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [40.7% done] [  7880/  6998 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [42.9% done] [  5978/  8058 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [46.4% done] [  5253/  6825 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [48.3% done] [ 10637/  3587 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [51.7% done] [  7160/  4178 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [55.2% done] [ 10397/  1709 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [56.7% done] [  7557/  3198 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [58.1% done] [  6400/  4162 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [61.3% done] [  7041/  2126 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [62.5% done] [  8916/   437 kb/s] [eta 00m:12s]
Threads: 3: [VVV] [67.7% done] [  7179/  1610 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.0% done] [ 19046/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [76.7% done] [ 18422/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [80.0% done] [ 21267/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.2% done] [ 18278/     0 kb/s] [eta 00m:06s]
fio: (groupid=0): err= 0: pid=15299
  read : io=100MiB, bw=3,944KiB/s, runt= 26580msec
    slat (msec): min=    0, max= 5155, avg=723.82, stdev=1430.23
    clat (msec): min=    0, max=  471, avg=92.00, stdev=81.06
    bw (KiB/s) : min=  392, max= 9452, per=35.54%, avg=4166.29, stdev=2340.36
  write: io=31,348KiB, bw=1,485KiB/s, runt= 21608msec
    slat (msec): min=    0, max=    2, avg= 0.06, stdev= 0.27
    clat (msec): min=    0, max=  914, avg=114.76, stdev=128.05
    bw (KiB/s) : min=    0, max= 6164, per=54.28%, avg=2468.33, stdev=2086.13
  cpu          : usr=3.30%, sys=0.18%, ctx=1816
  IO depths    : 1=0.1%, 2=0.2%, 4=11.4%, 8=88.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.0%, 4=0.3%, 10=4.0%, 20=13.8%, 50=21.7%, 100=20.4%
     lat (msec): 250=31.9%, 500=6.3%, 750=0.3%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15300
  read : io=100MiB, bw=3,910KiB/s, runt= 26812msec
    slat (msec): min=    0, max= 6601, avg=1369.60, stdev=2104.52
    clat (msec): min=    3, max=  428, avg=91.02, stdev=75.33
    bw (KiB/s) : min=  132, max= 8944, per=38.40%, avg=4500.95, stdev=2481.03
  write: io=28,212KiB, bw=1,424KiB/s, runt= 20281msec
    slat (msec): min=    0, max=    2, avg= 0.06, stdev= 0.27
    clat (msec): min=    0, max=  906, avg=98.76, stdev=90.62
    bw (KiB/s) : min=    0, max= 5915, per=55.79%, avg=2536.74, stdev=1902.99
  cpu          : usr=3.68%, sys=0.21%, ctx=1758
  IO depths    : 1=0.1%, 2=0.2%, 4=13.9%, 8=85.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.3%, 4=0.2%, 10=3.6%, 20=11.2%, 50=21.2%, 100=26.2%
     lat (msec): 250=31.6%, 500=5.4%, 750=0.0%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15301
  read : io=100MiB, bw=3,907KiB/s, runt= 26835msec
    slat (msec): min=    0, max= 5955, avg=1020.69, stdev=1759.43
    clat (msec): min=    2, max=  390, avg=92.10, stdev=71.82
    bw (KiB/s) : min=   67, max= 9997, per=37.26%, avg=4367.14, stdev=2718.12
  write: io=36,408KiB, bw=1,792KiB/s, runt= 20797msec
    slat (msec): min=    0, max=    5, avg= 0.13, stdev= 0.56
    clat (msec): min=    0, max=  712, avg=119.76, stdev=108.26
    bw (KiB/s) : min=    0, max=11484, per=65.31%, avg=2969.52, stdev=2612.67
  cpu          : usr=3.53%, sys=0.31%, ctx=1751
  IO depths    : 1=0.1%, 2=0.3%, 4=12.1%, 8=87.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.8%, 4=0.4%, 10=1.5%, 20=9.3%, 50=21.6%, 100=26.5%
     lat (msec): 250=33.8%, 500=5.8%, 750=0.2%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,722KiB/s, minb=3,907KiB/s, maxb=3,944KiB/s, mint=26580msec, maxt=26835msec
  WRITE: io=95,968KiB, aggrb=4,547KiB/s, minb=1,424KiB/s, maxb=1,792KiB/s, mint=26580msec, maxt=26835msec

Disk stats (read/write):
  sda: ios=5030/1577, merge=1251/338, ticks=475180/197992, in_queue=673376, util=99.46%
2.85user 0.23system 0:27.13elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2375minor)pagefaults 0swaps