fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [42.9% done] [  5301/ 51802 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [40.0% done] [   248/  9724 kb/s] [eta 00m:06s]
Threads: 3: [FFm] [62.5% done] [   380/ 35716 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [     0/  8319 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.4% done] [     0/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [70.0% done] [ 20540/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [71.4% done] [ 30904/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 27016/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [89.5% done] [ 33160/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [94.7% done] [ 34380/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35988/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 29644/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37032/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [100.0% done] [ 34244/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=14451
  read : io=100MiB, bw=4,730KiB/s, runt= 22168msec
    slat (msec): min=   85, max=20723, avg=16414.29, stdev=2951.57
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    2, max=20896, per=74.54%, avg=10450.18, stdev=6551.14
  write: io=98MiB, bw=7,959KiB/s, runt= 12957msec
    slat (msec): min=    0, max=   91, avg= 2.18, stdev= 5.31
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=96085, per=163.31%, avg=36649.67, stdev=51937.19
  cpu          : usr=5.36%, sys=1.62%, ctx=742
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14452
  read : io=100MiB, bw=4,865KiB/s, runt= 21551msec
    slat (msec): min=   41, max=18520, avg=13454.83, stdev=4712.68
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=23186, per=65.28%, avg=9151.00, stdev=5943.99
  write: io=88,260KiB, bw=6,960KiB/s, runt= 12984msec
    slat (msec): min=    0, max=   13, avg= 1.74, stdev= 1.93
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=53723, per=119.69%, avg=26861.50, stdev=37987.90
  cpu          : usr=5.18%, sys=1.74%, ctx=945
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14453
  read : io=100MiB, bw=4,673KiB/s, runt= 22438msec
    slat (msec): min=   40, max=17377, avg=13354.88, stdev=4037.16
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=20213, per=51.85%, avg=7269.32, stdev=6341.57
  write: io=95,592KiB, bw=7,541KiB/s, runt= 12980msec
    slat (msec): min=    0, max=   43, avg= 1.96, stdev= 3.08
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=98273, per=146.12%, avg=32792.33, stdev=56707.94
  cpu          : usr=5.60%, sys=1.84%, ctx=894
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=14,019KiB/s, minb=4,673KiB/s, maxb=4,865KiB/s, mint=21551msec, maxt=22438msec
  WRITE: io=278MiB, aggrb=22,442KiB/s, minb=6,960KiB/s, maxb=7,959KiB/s, mint=21551msec, maxt=22438msec

Disk stats (read/write):
  sda: ios=3220/1789, merge=1055/69330, ticks=82060/1583788, in_queue=1665848, util=98.63%
3.60user 1.18system 0:22.77elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2412minor)pagefaults 0swaps