fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [   396/ 63372 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [71.4% done] [  2552/     0 kb/s] [eta 00m:04s]
Threads: 3: [VFF] [78.6% done] [  9632/     0 kb/s] [eta 00m:03s]
Threads: 3: [VFF] [85.7% done] [ 11676/     0 kb/s] [eta 00m:02s]
Threads: 3: [VFF] [92.9% done] [  9456/     0 kb/s] [eta 00m:01s]
Threads: 3: [VFF] [100.0% done] [  8268/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [100.0% done] [ 27748/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [100.0% done] [  8488/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.0% done] [ 18960/     0 kb/s] [eta 00m:08s]
Threads: 2: [_VV] [72.0% done] [ 32327/     0 kb/s] [eta 00m:07s]
Threads: 2: [_VV] [86.4% done] [ 31360/     0 kb/s] [eta 00m:03s]
Threads: 2: [_VV] [95.2% done] [ 28892/     0 kb/s] [eta 00m:01s]
Threads: 2: [_VV] [100.0% done] [ 37568/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 30220/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=17151
  read : io=100MiB, bw=5,773KiB/s, runt= 18163msec
    slat (msec): min=   54, max=16190, avg=12022.35, stdev=3042.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=28114, per=75.15%, avg=10102.83, stdev=7408.45
  write: io=97,364KiB, bw=10,499KiB/s, runt=  9496msec
    slat (msec): min=    0, max=   58, avg= 2.09, stdev= 3.82
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=100445, per=184.07%, avg=33602.00, stdev=57888.02
  cpu          : usr=7.03%, sys=1.94%, ctx=825
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17152
  read : io=100MiB, bw=4,533KiB/s, runt= 23132msec
    slat (msec): min=   63, max=20659, avg=17134.57, stdev=4191.83
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=24620, per=81.81%, avg=10998.80, stdev=8048.88
  write: io=97,116KiB, bw=6,106KiB/s, runt= 16285msec
    slat (msec): min=    0, max=   66, avg= 2.01, stdev= 3.79
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=101290, per=185.29%, avg=33825.00, stdev=58426.48
  cpu          : usr=5.33%, sys=1.73%, ctx=901
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17153
  read : io=100MiB, bw=4,481KiB/s, runt= 23398msec
    slat (msec): min=   63, max=21377, avg=18020.10, stdev=3642.28
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=23019, per=91.76%, avg=12336.71, stdev=8447.97
  write: io=95,844KiB, bw=6,028KiB/s, runt= 16281msec
    slat (msec): min=    0, max=   11, avg= 1.74, stdev= 1.88
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114224, per=312.86%, avg=57112.00, stdev=80768.56
  cpu          : usr=5.18%, sys=1.78%, ctx=828
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,444KiB/s, minb=4,481KiB/s, maxb=5,773KiB/s, mint=18163msec, maxt=23398msec
  WRITE: io=284MiB, aggrb=18,255KiB/s, minb=6,028KiB/s, maxb=10,499KiB/s, mint=18163msec, maxt=23398msec

Disk stats (read/write):
  sda: ios=3135/1843, merge=1457/70648, ticks=64236/1953568, in_queue=2054100, util=99.26%
3.76user 1.20system 0:23.64elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2421minor)pagefaults 0swaps