fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [42.9% done] [ 11476/ 73740 kb/s] [eta 00m:04s]
Threads: 3: [mmF] [50.0% done] [  7423/ 18738 kb/s] [eta 00m:04s]
Threads: 3: [mmF] [50.0% done] [  8584/     0 kb/s] [eta 00m:05s]
Threads: 3: [mFF] [50.0% done] [  5576/ 25172 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [50.0% done] [   300/     0 kb/s] [eta 00m:07s]
Threads: 3: [FFF] [100.0% done] [   444/ 25696 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.2% done] [ 13604/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [73.1% done] [ 28548/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [71.4% done] [ 26796/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [75.0% done] [ 27648/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [78.6% done] [ 30840/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [85.2% done] [ 29000/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [92.3% done] [ 25953/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 29508/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 33132/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=31615
  read : io=100MiB, bw=3,918KiB/s, runt= 26757msec
    slat (msec): min=   39, max=19401, avg=14143.94, stdev=6662.89
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    1, max=31940, per=57.70%, avg=6783.77, stdev=7203.90
  write: io=79,392KiB, bw=4,696KiB/s, runt= 17312msec
    slat (msec): min=    0, max=   42, avg= 1.84, stdev= 3.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=102577, per=227.65%, avg=34222.33, stdev=59196.89
  cpu          : usr=4.26%, sys=1.18%, ctx=1067
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=31616
  read : io=100MiB, bw=4,018KiB/s, runt= 26092msec
    slat (msec): min=   38, max=20202, avg=13264.58, stdev=7017.83
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   16, max=19149, per=61.30%, avg=7206.31, stdev=5167.76
  write: io=80,816KiB, bw=4,783KiB/s, runt= 17302msec
    slat (msec): min=    0, max=   47, avg= 2.02, stdev= 3.42
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=105280, per=233.71%, avg=35134.00, stdev=60748.25
  cpu          : usr=4.15%, sys=1.29%, ctx=1117
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=31617
  read : io=100MiB, bw=4,102KiB/s, runt= 25557msec
    slat (msec): min=   98, max=22454, avg=17244.60, stdev=4790.56
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=27952, per=81.56%, avg=9588.17, stdev=7965.37
  write: io=93,944KiB, bw=5,576KiB/s, runt= 17250msec
    slat (msec): min=    0, max=  174, avg= 2.33, stdev= 8.99
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=84605, per=187.88%, avg=28244.67, stdev=48809.52
  cpu          : usr=4.74%, sys=1.49%, ctx=874
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,756KiB/s, minb=3,918KiB/s, maxb=4,102KiB/s, mint=25557msec, maxt=26757msec
  WRITE: io=248MiB, aggrb=15,033KiB/s, minb=4,696KiB/s, maxb=5,576KiB/s, mint=25557msec, maxt=26757msec

Disk stats (read/write):
  sda: ios=3772/2288, merge=1500/61087, ticks=79836/2052244, in_queue=2134976, util=98.89%
3.50user 1.03system 0:27.04elapsed 16%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2436minor)pagefaults 0swaps