fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [30.0% done] [  7228/     0 kb/s] [eta 00m:07s]
Threads: 3: [FmF] [30.8% done] [  2966/ 36023 kb/s] [eta 00m:09s]
Threads: 3: [FmF] [31.2% done] [  1688/     0 kb/s] [eta 00m:11s]
Threads: 3: [FmF] [33.3% done] [  1704/     0 kb/s] [eta 00m:12s]
Threads: 3: [FmF] [53.8% done] [  2192/ 26296 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [     0/ 24504 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.6% done] [ 16047/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 26060/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [78.3% done] [ 28375/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [86.4% done] [ 27584/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.2% done] [ 34388/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 36004/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34556/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 25975/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32275/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=4113
  read : io=100MiB, bw=4,214KiB/s, runt= 24882msec
    slat (msec): min=   53, max=21093, avg=15830.33, stdev=5049.66
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=18657, per=63.67%, avg=8049.14, stdev=5870.96
  write: io=91,760KiB, bw=6,160KiB/s, runt= 15252msec
    slat (msec): min=    0, max=   12, avg= 1.90, stdev= 2.01
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=23565, per=63.78%, avg=11782.50, stdev=16662.97
  cpu          : usr=4.82%, sys=1.41%, ctx=970
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4114
  read : io=100MiB, bw=4,248KiB/s, runt= 24680msec
    slat (msec): min=   50, max=17428, avg=11843.30, stdev=5016.39
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   23, max=19878, per=54.81%, avg=6929.00, stdev=5987.26
  write: io=83,948KiB, bw=5,636KiB/s, runt= 15252msec
    slat (msec): min=    0, max=   46, avg= 2.15, stdev= 3.63
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max= 6065, per=16.42%, avg=3032.50, stdev=4288.60
  cpu          : usr=5.07%, sys=1.64%, ctx=1170
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4115
  read : io=100MiB, bw=4,238KiB/s, runt= 24738msec
    slat (msec): min=   77, max=23091, avg=18604.76, stdev=3278.11
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=22918, per=81.75%, avg=10334.83, stdev=6136.38
  write: io=99,448KiB, bw=6,680KiB/s, runt= 15244msec
    slat (msec): min=    0, max=   76, avg= 2.55, stdev= 4.87
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=113208, per=339.28%, avg=62674.33, stdev=57572.21
  cpu          : usr=5.58%, sys=1.76%, ctx=809
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,642KiB/s, minb=4,214KiB/s, maxb=4,248KiB/s, mint=24680msec, maxt=24882msec
  WRITE: io=269MiB, aggrb=18,473KiB/s, minb=5,636KiB/s, maxb=6,680KiB/s, mint=24680msec, maxt=24882msec

Disk stats (read/write):
  sda: ios=3475/2093, merge=1257/66481, ticks=79704/1899008, in_queue=1991192, util=97.42%
3.88user 1.21system 0:25.29elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2412minor)pagefaults 0swaps