fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [42.9% done] [     0/ 83269 kb/s] [eta 00m:04s]
Threads: 3: [Fmm] [40.0% done] [  2100/  1700 kb/s] [eta 00m:06s]
Threads: 3: [FmF] [41.7% done] [     0/ 36664 kb/s] [eta 00m:07s]
Threads: 3: [FmF] [40.0% done] [     0/     0 kb/s] [eta 00m:09s]
Threads: 3: [FmF] [41.2% done] [     0/     0 kb/s] [eta 00m:10s]
Threads: 3: [FmF] [42.1% done] [   632/     0 kb/s] [eta 00m:11s]
Threads: 3: [FmF] [40.9% done] [     0/     0 kb/s] [eta 00m:13s]
Threads: 3: [FmF] [41.7% done] [     0/     0 kb/s] [eta 00m:14s]
Threads: 3: [FmF] [40.7% done] [     0/     0 kb/s] [eta 00m:16s]
Threads: 3: [VFV] [70.6% done] [  2404/ 39892 kb/s] [eta 00m:05s]
Threads: 3: [VFV] [76.5% done] [ 18160/     0 kb/s] [eta 00m:04s]
Threads: 3: [VFV] [82.4% done] [ 20040/     0 kb/s] [eta 00m:03s]
Threads: 3: [VFV] [88.2% done] [ 20996/     0 kb/s] [eta 00m:02s]
Threads: 3: [VFV] [94.1% done] [ 22944/     0 kb/s] [eta 00m:01s]
Threads: 3: [VFV] [100.0% done] [ 26940/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFV] [100.0% done] [ 23972/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFV] [100.0% done] [ 24860/     0 kb/s] [eta 00m:00s]
Threads: 2: [VVE] [69.0% done] [ 27412/     0 kb/s] [eta 00m:09s]
Threads: 1: [_V_] [91.3% done] [ 35820/     0 kb/s] [eta 00m:02s]
Threads: 1: [_V_] [100.0% done] [ 34556/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=7954
  read : io=100MiB, bw=5,101KiB/s, runt= 20555msec
    slat (msec): min=  198, max=18319, avg=14362.21, stdev=3246.67
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=16970, per=69.67%, avg=9437.29, stdev=5082.67
  write: io=96,708KiB, bw=8,642KiB/s, runt= 11459msec
    slat (msec): min=    0, max=   11, avg= 1.84, stdev= 1.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=116756, per=389.29%, avg=58378.00, stdev=82558.96
  cpu          : usr=5.99%, sys=1.69%, ctx=888
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=7955
  read : io=100MiB, bw=4,515KiB/s, runt= 23222msec
    slat (msec): min=   79, max=11585, avg=9702.33, stdev=2346.14
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=40349, per=112.37%, avg=15221.62, stdev=16977.14
  write: io=95,632KiB, bw=5,027KiB/s, runt= 19477msec
    slat (msec): min=    0, max=   35, avg= 1.93, stdev= 2.96
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max= 5063, per=16.88%, avg=2531.50, stdev=3580.08
  cpu          : usr=5.18%, sys=1.69%, ctx=923
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=7956
  read : io=100MiB, bw=5,152KiB/s, runt= 20351msec
    slat (msec): min=  133, max=16060, avg=11683.80, stdev=3437.38
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=15514, per=62.73%, avg=8497.40, stdev=5072.52
  write: io=92,900KiB, bw=8,304KiB/s, runt= 11455msec
    slat (msec): min=    0, max=   10, avg= 1.93, stdev= 2.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=26778, per=89.28%, avg=13389.00, stdev=18934.91
  cpu          : usr=5.82%, sys=1.91%, ctx=984
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,546KiB/s, minb=4,515KiB/s, maxb=5,152KiB/s, mint=20351msec, maxt=23222msec
  WRITE: io=279MiB, aggrb=14,996KiB/s, minb=5,027KiB/s, maxb=8,642KiB/s, mint=20351msec, maxt=23222msec

Disk stats (read/write):
  sda: ios=3267/1930, merge=1225/69407, ticks=85120/2077448, in_queue=2162564, util=97.96%
3.67user 1.18system 0:23.59elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2414minor)pagefaults 0swaps