fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [30.0% done] [  1256/     0 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [30.8% done] [  1209/ 12728 kb/s] [eta 00m:09s]
Threads: 3: [FFF] [100.0% done] [   616/ 56132 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  2432/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 24880/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [70.8% done] [ 37160/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [75.0% done] [ 26988/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [79.2% done] [ 32044/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.0% done] [ 37216/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [91.3% done] [ 29348/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 39440/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 32680/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=11999
  read : io=100MiB, bw=4,332KiB/s, runt= 24201msec
    slat (msec): min=   53, max=19460, avg=16031.53, stdev=4455.50
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=33588, per=69.01%, avg=8970.33, stdev=8472.84
  write: io=90,288KiB, bw=6,254KiB/s, runt= 14782msec
    slat (msec): min=    0, max=   17, avg= 2.23, stdev= 3.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=11508, per=28.50%, avg=5754.00, stdev=8137.38
  cpu          : usr=5.69%, sys=1.47%, ctx=987
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12000
  read : io=100MiB, bw=4,569KiB/s, runt= 22947msec
    slat (msec): min=  196, max=21375, avg=17017.41, stdev=3116.08
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    1, max=21758, per=91.06%, avg=11836.00, stdev=6192.48
  write: io=99MiB, bw=7,047KiB/s, runt= 14728msec
    slat (msec): min=    0, max=   15, avg= 2.06, stdev= 2.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=47409, per=117.41%, avg=23704.50, stdev=33523.23
  cpu          : usr=5.35%, sys=1.59%, ctx=858
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12001
  read : io=100MiB, bw=4,447KiB/s, runt= 23579msec
    slat (msec): min=   60, max=19733, avg=15559.12, stdev=3384.22
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=19721, per=61.30%, avg=7967.70, stdev=6601.81
  write: io=99,892KiB, bw=6,917KiB/s, runt= 14786msec
    slat (msec): min=    0, max=  120, avg= 2.92, stdev= 7.74
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=88564, per=150.31%, avg=30348.40, stdev=41853.71
  cpu          : usr=6.14%, sys=1.56%, ctx=975
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,998KiB/s, minb=4,332KiB/s, maxb=4,569KiB/s, mint=22947msec, maxt=24201msec
  WRITE: io=285MiB, aggrb=20,190KiB/s, minb=6,254KiB/s, maxb=7,047KiB/s, mint=22947msec, maxt=24201msec

Disk stats (read/write):
  sda: ios=3121/1997, merge=1169/70762, ticks=91988/1801244, in_queue=1893684, util=97.14%
4.11user 1.09system 0:24.47elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps