fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [8.8% done] [  1933/ 16103 kb/s] [eta 00m:31s]
Threads: 3: [Fmm] [8.9% done] [     0/     0 kb/s] [eta 00m:41s]
Threads: 3: [Fmm] [8.9% done] [     0/     0 kb/s] [eta 00m:51s]
Threads: 3: [Fmm] [10.0% done] [   556/ 27404 kb/s] [eta 00m:54s]
Threads: 3: [FmF] [16.3% done] [   916/ 25528 kb/s] [eta 00m:36s]
Threads: 3: [FmF] [47.1% done] [   300/ 44423 kb/s] [eta 00m:09s]
Threads: 3: [FmF] [47.4% done] [     0/     0 kb/s] [eta 00m:10s]
Threads: 3: [FmF] [45.5% done] [     0/     0 kb/s] [eta 00m:12s]
Threads: 3: [VmF] [45.8% done] [   504/     0 kb/s] [eta 00m:13s]
Threads: 3: [VmF] [46.2% done] [   616/     0 kb/s] [eta 00m:14s]
Threads: 3: [VmF] [46.4% done] [   348/     0 kb/s] [eta 00m:15s]
Threads: 3: [VmV] [46.7% done] [ 12884/     0 kb/s] [eta 00m:16s]
Threads: 3: [VmV] [46.9% done] [ 28780/     0 kb/s] [eta 00m:17s]
Threads: 3: [VmV] [47.1% done] [ 33980/     0 kb/s] [eta 00m:18s]
Threads: 3: [VmV] [47.2% done] [ 30738/     0 kb/s] [eta 00m:19s]
Threads: 3: [VFV] [100.0% done] [ 36480/ 29796 kb/s] [eta 00m:00s]
Threads: 3: [VFV] [100.0% done] [ 23684/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFV] [100.0% done] [ 18116/     0 kb/s] [eta 00m:00s]
Threads: 2: [_FV] [100.0% done] [  1764/     0 kb/s] [eta 00m:00s]
Threads: 1: [_V_] [73.3% done] [ 17740/     0 kb/s] [eta 00m:08s]
Threads: 1: [_V_] [95.8% done] [ 31272/     0 kb/s] [eta 00m:01s]
Threads: 1: [_V_] [100.0% done] [ 29988/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=2493
  read : io=100MiB, bw=5,148KiB/s, runt= 20368msec
    slat (msec): min=  535, max=18305, avg=14514.41, stdev=2285.88
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=23559, per=96.88%, avg=12252.93, stdev=7465.89
  write: io=99,820KiB, bw=10,053KiB/s, runt= 10167msec
    slat (msec): min=    0, max=   16, avg= 2.04, stdev= 2.27
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=103705, per=397.89%, avg=51852.50, stdev=73330.51
  cpu          : usr=6.34%, sys=1.89%, ctx=747
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2494
  read : io=100MiB, bw=4,215KiB/s, runt= 24873msec
    slat (msec): min=   58, max= 6755, avg=4929.64, stdev=1719.28
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   41, max=35622, per=79.50%, avg=10054.44, stdev=13920.59
  write: io=84,620KiB, bw=3,960KiB/s, runt= 21881msec
    slat (msec): min=    0, max=  482, avg= 2.08, stdev=12.57
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=57306, per=146.60%, avg=19104.67, stdev=33083.33
  cpu          : usr=4.66%, sys=1.51%, ctx=1105
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2495
  read : io=100MiB, bw=4,773KiB/s, runt= 21968msec
    slat (msec): min=   66, max=15821, avg=11318.25, stdev=3174.57
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   15, max=20594, per=75.43%, avg=9539.16, stdev=6526.73
  write: io=94,032KiB, bw=7,191KiB/s, runt= 13390msec
    slat (msec): min=    0, max=   12, avg= 1.85, stdev= 1.92
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=11431, per=43.86%, avg=5715.50, stdev=8082.94
  cpu          : usr=5.44%, sys=1.77%, ctx=902
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,647KiB/s, minb=4,215KiB/s, maxb=5,148KiB/s, mint=20368msec, maxt=24873msec
  WRITE: io=272MiB, aggrb=13,032KiB/s, minb=3,960KiB/s, maxb=10,053KiB/s, mint=20368msec, maxt=24873msec

Disk stats (read/write):
  sda: ios=3390/2624, merge=1203/66961, ticks=77332/1904640, in_queue=1983900, util=97.73%
3.71user 1.18system 0:25.30elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2427minor)pagefaults 0swaps