fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [42.9% done] [   951/ 39861 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [  1220/ 78663 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [ 10960/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.2% done] [ 20139/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [80.0% done] [ 33347/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [85.0% done] [ 32803/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [90.0% done] [ 29735/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 34472/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37513/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37376/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 28703/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5142
  read : io=100MiB, bw=4,811KiB/s, runt= 21791msec
    slat (msec): min=  253, max=20319, avg=16606.13, stdev=2843.97
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=18848, per=79.46%, avg=10746.40, stdev=5410.17
  write: io=98MiB, bw=7,712KiB/s, runt= 13341msec
    slat (msec): min=    0, max=   13, avg= 1.79, stdev= 2.00
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111450, per=260.67%, avg=55725.00, stdev=78807.05
  cpu          : usr=5.89%, sys=1.69%, ctx=828
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5143
  read : io=100MiB, bw=4,508KiB/s, runt= 23257msec
    slat (msec): min=  113, max=19636, avg=15362.64, stdev=3920.61
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   13, max=21685, per=61.88%, avg=8369.35, stdev=5933.80
  write: io=95,392KiB, bw=7,063KiB/s, runt= 13830msec
    slat (msec): min=    0, max=  116, avg= 2.18, stdev= 6.16
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=90044, per=140.85%, avg=30110.00, stdev=51904.56
  cpu          : usr=5.23%, sys=1.55%, ctx=937
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5144
  read : io=100MiB, bw=4,526KiB/s, runt= 23166msec
    slat (msec): min=  112, max=19422, avg=15210.14, stdev=3955.25
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    1, max=17312, per=63.82%, avg=8631.37, stdev=5424.99
  write: io=93,652KiB, bw=6,915KiB/s, runt= 13868msec
    slat (msec): min=    0, max=  425, avg= 2.74, stdev=21.10
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=62004, per=97.20%, avg=20780.00, stdev=35701.43
  cpu          : usr=5.42%, sys=1.54%, ctx=1024
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,525KiB/s, minb=4,508KiB/s, maxb=4,811KiB/s, mint=21791msec, maxt=23257msec
  WRITE: io=283MiB, aggrb=21,378KiB/s, minb=6,915KiB/s, maxb=7,712KiB/s, mint=21791msec, maxt=23257msec

Disk stats (read/write):
  sda: ios=3156/1794, merge=1269/70595, ticks=103272/1663936, in_queue=1767208, util=99.22%
3.81user 1.09system 0:23.61elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2414minor)pagefaults 0swaps