fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [5.4% done] [  2256/ 30296 kb/s] [eta 00m:53s]
Threads: 3: [mmF] [25.0% done] [  1744/ 37500 kb/s] [eta 00m:12s]
Threads: 3: [mFF] [45.5% done] [   864/ 82636 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [54.5% done] [  1228/ 10772 kb/s] [eta 00m:05s]
Threads: 3: [FFF] [100.0% done] [     0/ 23876 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [70.0% done] [  8224/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [68.2% done] [ 27724/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.2% done] [ 31080/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [81.0% done] [ 28648/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [85.7% done] [ 34368/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [90.5% done] [ 36248/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 30348/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 38872/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 30580/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=8368
  read : io=100MiB, bw=4,568KiB/s, runt= 22951msec
    slat (msec): min=  173, max=16731, avg=13147.84, stdev=3771.87
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=24803, per=53.76%, avg=7367.67, stdev=6307.55
  write: io=91,824KiB, bw=6,975KiB/s, runt= 13479msec
    slat (msec): min=    0, max=  294, avg= 2.54, stdev=16.50
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=74119, per=113.54%, avg=24796.00, stdev=42715.18
  cpu          : usr=5.28%, sys=1.43%, ctx=972
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=8369
  read : io=100MiB, bw=4,737KiB/s, runt= 22134msec
    slat (msec): min=  114, max=17160, avg=12304.25, stdev=3611.12
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   24, max=18958, per=59.70%, avg=8181.95, stdev=5985.61
  write: io=93,256KiB, bw=7,088KiB/s, runt= 13471msec
    slat (msec): min=    0, max=  144, avg= 3.16, stdev=13.80
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=64186, per=99.05%, avg=21632.00, stdev=36854.55
  cpu          : usr=5.33%, sys=1.81%, ctx=986
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=8370
  read : io=100MiB, bw=4,653KiB/s, runt= 22534msec
    slat (msec): min=13110, max=21582, avg=17875.20, stdev=2308.69
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   17, max=18666, per=84.68%, avg=11605.93, stdev=5085.99
  write: io=100MiB, bw=7,783KiB/s, runt= 13471msec
    slat (msec): min=    0, max=   17, avg= 2.00, stdev= 2.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114900, per=263.06%, avg=57450.00, stdev=81246.57
  cpu          : usr=5.57%, sys=1.86%, ctx=900
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,706KiB/s, minb=4,568KiB/s, maxb=4,737KiB/s, mint=22134msec, maxt=22951msec
  WRITE: io=281MiB, aggrb=21,839KiB/s, minb=6,975KiB/s, maxb=7,783KiB/s, mint=22134msec, maxt=22951msec

Disk stats (read/write):
  sda: ios=3184/1482, merge=1150/70176, ticks=98304/1624264, in_queue=1757408, util=99.02%
3.70user 1.18system 0:23.28elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2416minor)pagefaults 0swaps