fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [27.3% done] [  2284/  3064 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [66.7% done] [   240/ 52995 kb/s] [eta 00m:02s]
Threads: 3: [mFF] [71.4% done] [   866/  3225 kb/s] [eta 00m:02s]
Threads: 3: [FFF] [100.0% done] [     0/  3225 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [70.0% done] [   760/     0 kb/s] [eta 00m:06s]
Threads: 3: [FFV] [78.9% done] [ 16478/     0 kb/s] [eta 00m:04s]
Threads: 3: [FFV] [94.1% done] [ 20054/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [70.8% done] [ 29128/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [78.3% done] [ 32472/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [82.6% done] [ 32653/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.9% done] [ 33197/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.5% done] [ 28486/     0 kb/s] [eta 00m:01s]
Threads: 2: [VV_] [100.0% done] [ 40017/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [100.0% done] [ 30877/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=2901
  read : io=100MiB, bw=4,260KiB/s, runt= 24610msec
    slat (msec): min=   62, max=19516, avg=15047.31, stdev=4339.89
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    1, max=23241, per=65.07%, avg=8317.85, stdev=7436.19
  write: io=94,232KiB, bw=5,832KiB/s, runt= 16544msec
    slat (msec): min=    0, max=   67, avg= 2.79, stdev= 5.47
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=103611, per=155.59%, avg=28630.00, stdev=50239.89
  cpu          : usr=5.56%, sys=1.71%, ctx=963
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2902
  read : io=100MiB, bw=4,262KiB/s, runt= 24598msec
    slat (msec): min=   39, max=22945, avg=19486.93, stdev=3888.72
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=27338, per=98.71%, avg=12617.50, stdev=8647.38
  write: io=98MiB, bw=6,231KiB/s, runt= 16544msec
    slat (msec): min=    0, max=   41, avg= 2.59, stdev= 3.77
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=105564, per=237.29%, avg=43663.25, stdev=50750.81
  cpu          : usr=5.82%, sys=1.69%, ctx=845
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2903
  read : io=100MiB, bw=4,679KiB/s, runt= 22410msec
    slat (msec): min=13495, max=21487, avg=17065.19, stdev=2255.56
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=27562, per=96.70%, avg=12360.60, stdev=7580.80
  write: io=100MiB, bw=7,437KiB/s, runt= 14098msec
    slat (msec): min=    0, max=   10, avg= 1.96, stdev= 2.00
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114744, per=311.79%, avg=57372.00, stdev=81136.26
  cpu          : usr=5.68%, sys=1.54%, ctx=793
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,782KiB/s, minb=4,260KiB/s, maxb=4,679KiB/s, mint=22410msec, maxt=24610msec
  WRITE: io=290MiB, aggrb=18,401KiB/s, minb=5,832KiB/s, maxb=7,437KiB/s, mint=22410msec, maxt=24610msec

Disk stats (read/write):
  sda: ios=3115/2478, merge=1295/71649, ticks=65844/2054420, in_queue=2128024, util=97.42%
4.12user 1.19system 0:24.94elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2420minor)pagefaults 0swaps