fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [7.1% done] [  1690/ 46006 kb/s] [eta 00m:39s]
Threads: 3: [mFF] [7.7% done] [   906/     0 kb/s] [eta 00m:48s]
Threads: 3: [mFF] [8.3% done] [   621/     0 kb/s] [eta 00m:55s]
Threads: 3: [mFF] [46.2% done] [   902/ 57409 kb/s] [eta 00m:07s]
Threads: 3: [FFF] [100.0% done] [   702/ 32536 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  5132/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 29118/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 30435/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [78.3% done] [ 26038/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [86.4% done] [ 36144/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.2% done] [ 35978/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 36140/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30557/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33231/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=16974
  read : io=100MiB, bw=4,384KiB/s, runt= 23914msec
    slat (msec): min=   68, max=17541, avg=13319.93, stdev=3977.61
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=13790, per=54.76%, avg=7203.19, stdev=4967.56
  write: io=88,540KiB, bw=6,303KiB/s, runt= 14384msec
    slat (msec): min=    0, max=    9, avg= 1.51, stdev= 1.74
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=49117, per=118.73%, avg=24558.50, stdev=34730.96
  cpu          : usr=5.14%, sys=1.44%, ctx=1005
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16975
  read : io=100MiB, bw=4,436KiB/s, runt= 23633msec
    slat (msec): min=  159, max=21099, avg=16251.35, stdev=3481.40
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=18257, per=70.54%, avg=9279.22, stdev=5797.20
  write: io=99,700KiB, bw=7,095KiB/s, runt= 14388msec
    slat (msec): min=    0, max=   10, avg= 1.85, stdev= 1.95
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=26032, per=62.93%, avg=13016.00, stdev=18407.40
  cpu          : usr=5.18%, sys=1.57%, ctx=980
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16976
  read : io=100MiB, bw=4,405KiB/s, runt= 23801msec
    slat (msec): min=13636, max=22837, avg=18770.50, stdev=2508.48
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=15409, per=81.22%, avg=10683.13, stdev=4744.03
  write: io=100MiB, bw=7,307KiB/s, runt= 14349msec
    slat (msec): min=    0, max=   15, avg= 1.88, stdev= 2.23
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=103659, per=250.58%, avg=51829.50, stdev=73297.98
  cpu          : usr=5.24%, sys=1.71%, ctx=870
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,154KiB/s, minb=4,384KiB/s, maxb=4,436KiB/s, mint=23633msec, maxt=23914msec
  WRITE: io=284MiB, aggrb=20,684KiB/s, minb=6,303KiB/s, maxb=7,307KiB/s, mint=23633msec, maxt=23914msec

Disk stats (read/write):
  sda: ios=3125/1817, merge=1164/70692, ticks=112400/1909708, in_queue=2022440, util=98.03%
3.75user 1.20system 0:24.52elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2422minor)pagefaults 0swaps