fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [9.1% done] [  8396/ 46668 kb/s] [eta 00m:30s]
Threads: 3: [mFF] [10.3% done] [  1816/ 16627 kb/s] [eta 00m:35s]
Threads: 3: [mFF] [62.5% done] [  1212/ 78132 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [     0/  7576 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [ 12231/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 29520/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.0% done] [ 29524/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [85.7% done] [ 29676/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.0% done] [ 35680/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 33656/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33480/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 31040/     0 kb/s] [eta 00m:00s]
Threads: 2: [VEV] [100.0% done] [ 31712/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=16635
  read : io=100MiB, bw=4,472KiB/s, runt= 23447msec
    slat (msec): min=   61, max=18388, avg=13056.67, stdev=4403.14
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    2, max=17020, per=61.62%, avg=8174.48, stdev=4552.90
  write: io=85,708KiB, bw=6,159KiB/s, runt= 14249msec
    slat (msec): min=    0, max=   16, avg= 1.52, stdev= 1.92
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=117892, per=296.55%, avg=58946.00, stdev=83362.23
  cpu          : usr=5.08%, sys=1.36%, ctx=949
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16636
  read : io=100MiB, bw=4,492KiB/s, runt= 23341msec
    slat (msec): min=  254, max=21220, avg=16830.97, stdev=3564.84
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=17440, per=75.10%, avg=9961.76, stdev=5557.97
  write: io=98,388KiB, bw=7,070KiB/s, runt= 14249msec
    slat (msec): min=    0, max=   12, avg= 1.93, stdev= 2.08
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=110461, per=277.86%, avg=55230.50, stdev=78107.72
  cpu          : usr=5.21%, sys=1.78%, ctx=821
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16637
  read : io=100MiB, bw=4,421KiB/s, runt= 23714msec
    slat (msec): min=  113, max=20623, avg=15979.46, stdev=4664.33
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=19101, per=63.04%, avg=8362.25, stdev=5014.42
  write: io=92,504KiB, bw=6,648KiB/s, runt= 14248msec
    slat (msec): min=    0, max=  135, avg= 2.05, stdev= 5.19
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=84114, per=141.47%, avg=28120.33, stdev=48492.10
  cpu          : usr=5.03%, sys=1.55%, ctx=892
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,265KiB/s, minb=4,421KiB/s, maxb=4,492KiB/s, mint=23341msec, maxt=23714msec
  WRITE: io=270MiB, aggrb=19,877KiB/s, minb=6,159KiB/s, maxb=7,070KiB/s, mint=23341msec, maxt=23714msec

Disk stats (read/write):
  sda: ios=3377/1995, merge=1466/66917, ticks=88264/1703008, in_queue=1801336, util=98.96%
3.64user 1.14system 0:24.03elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps