fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [42.9% done] [  2872/ 34458 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [   601/ 47106 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.6% done] [  8700/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.0% done] [ 30464/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 31440/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [73.1% done] [ 31112/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [80.0% done] [ 32416/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.5% done] [ 29272/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.7% done] [ 36040/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35004/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 36864/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=11579
  read : io=100MiB, bw=4,241KiB/s, runt= 24724msec
    slat (msec): min=   52, max=21290, avg=17893.83, stdev=4704.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=39200, per=75.05%, avg=9548.41, stdev=9820.48
  write: io=94,904KiB, bw=6,373KiB/s, runt= 15248msec
    slat (msec): min=    0, max=  207, avg= 2.12, stdev= 9.10
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=79892, per=138.23%, avg=26680.33, stdev=46082.72
  cpu          : usr=4.85%, sys=1.62%, ctx=1113
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=11580
  read : io=100MiB, bw=4,427KiB/s, runt= 23682msec
    slat (msec): min=   52, max=20752, avg=15853.31, stdev=4143.98
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=19639, per=74.33%, avg=9457.00, stdev=6338.85
  write: io=97,448KiB, bw=6,546KiB/s, runt= 15242msec
    slat (msec): min=    0, max=  247, avg= 2.06, stdev= 6.68
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=109413, per=220.62%, avg=42584.00, stdev=58597.49
  cpu          : usr=5.24%, sys=1.62%, ctx=982
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=11581
  read : io=100MiB, bw=4,373KiB/s, runt= 23977msec
    slat (msec): min=   51, max=21901, avg=17409.95, stdev=3877.27
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=20504, per=79.37%, avg=10098.75, stdev=5268.06
  write: io=95,072KiB, bw=6,389KiB/s, runt= 15237msec
    slat (msec): min=    0, max=   11, avg= 1.59, stdev= 1.76
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=115079, per=298.10%, avg=57539.50, stdev=81373.14
  cpu          : usr=5.00%, sys=1.45%, ctx=989
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,723KiB/s, minb=4,241KiB/s, maxb=4,427KiB/s, mint=23682msec, maxt=24724msec
  WRITE: io=281MiB, aggrb=19,302KiB/s, minb=6,373KiB/s, maxb=6,546KiB/s, mint=23682msec, maxt=24724msec

Disk stats (read/write):
  sda: ios=3271/1976, merge=1288/69528, ticks=86220/1852396, in_queue=1963540, util=97.53%
3.68user 1.16system 0:25.31elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2425minor)pagefaults 0swaps