fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [42.9% done] [  1584/ 83696 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [40.0% done] [     0/  8460 kb/s] [eta 00m:06s]
Threads: 3: [FFm] [41.7% done] [   628/     0 kb/s] [eta 00m:07s]
Threads: 3: [FFm] [42.9% done] [     0/     0 kb/s] [eta 00m:08s]
Threads: 3: [FFm] [41.2% done] [     0/     0 kb/s] [eta 00m:10s]
Threads: 3: [FFm] [42.1% done] [     0/     0 kb/s] [eta 00m:11s]
Threads: 3: [FFm] [40.9% done] [     0/     0 kb/s] [eta 00m:13s]
Threads: 3: [FFm] [41.7% done] [     0/     0 kb/s] [eta 00m:14s]
Threads: 3: [FFm] [55.0% done] [   512/ 19920 kb/s] [eta 00m:09s]
Threads: 3: [FFm] [63.2% done] [     0/ 11811 kb/s] [eta 00m:07s]
Threads: 3: [VVm] [61.9% done] [ 20244/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVm] [63.6% done] [ 28040/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVm] [65.2% done] [ 27252/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVm] [64.0% done] [ 26488/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVF] [100.0% done] [ 31896/  4140 kb/s] [eta 00m:00s]
Threads: 2: [V_F] [100.0% done] [ 26974/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_F] [100.0% done] [ 16716/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [66.7% done] [ 13228/     0 kb/s] [eta 00m:10s]
Threads: 1: [__V] [80.8% done] [ 24344/     0 kb/s] [eta 00m:05s]
Threads: 1: [__V] [100.0% done] [ 35140/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [100.0% done] [ 33668/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=2617
  read : io=100MiB, bw=5,067KiB/s, runt= 20692msec
    slat (msec): min=  111, max=19144, avg=15823.97, stdev=2735.29
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=24835, per=88.57%, avg=11817.86, stdev=8801.82
  write: io=99MiB, bw=8,380KiB/s, runt= 12339msec
    slat (msec): min=    0, max=  115, avg= 2.01, stdev= 5.82
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=92081, per=211.68%, avg=30879.33, stdev=53002.93
  cpu          : usr=5.80%, sys=1.80%, ctx=842
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2618
  read : io=100MiB, bw=5,835KiB/s, runt= 17968msec
    slat (msec): min=   77, max=14954, avg=11232.06, stdev=2972.86
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   24, max=30873, per=100.11%, avg=13358.00, stdev=9366.59
  write: io=92,156KiB, bw=7,638KiB/s, runt= 12355msec
    slat (msec): min=    0, max=   16, avg= 1.86, stdev= 2.12
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114155, per=391.26%, avg=57077.50, stdev=80719.77
  cpu          : usr=6.77%, sys=1.89%, ctx=974
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2619
  read : io=100MiB, bw=4,447KiB/s, runt= 23575msec
    slat (msec): min=   19, max= 6827, avg=4921.59, stdev=1776.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=39239, per=75.32%, avg=10049.71, stdev=15076.06
  write: io=92,032KiB, bw=4,708KiB/s, runt= 20016msec
    slat (msec): min=    0, max=  201, avg= 3.22, stdev=15.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=91420, per=165.95%, avg=24209.50, stdev=44878.73
  cpu          : usr=5.04%, sys=1.73%, ctx=1111
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,343KiB/s, minb=4,447KiB/s, maxb=5,835KiB/s, mint=17968msec, maxt=23575msec
  WRITE: io=278MiB, aggrb=14,588KiB/s, minb=4,708KiB/s, maxb=8,380KiB/s, mint=17968msec, maxt=23575msec

Disk stats (read/write):
  sda: ios=3374/2188, merge=1382/69020, ticks=79088/1808672, in_queue=1889364, util=98.00%
3.64user 1.16system 0:24.00elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2420minor)pagefaults 0swaps