fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [42.9% done] [  4220/ 52706 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [   420/ 36824 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [68.8% done] [     0/     0 kb/s] [eta 00m:05s]
Threads: 3: [FFV] [75.0% done] [  8756/     0 kb/s] [eta 00m:04s]
Threads: 3: [FFV] [81.2% done] [  7396/     0 kb/s] [eta 00m:03s]
Threads: 3: [FFV] [87.5% done] [ 11816/     0 kb/s] [eta 00m:02s]
Threads: 3: [FFV] [93.8% done] [  7488/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [66.7% done] [ 23280/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [70.8% done] [ 34292/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [78.3% done] [ 29356/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [86.4% done] [ 24236/     0 kb/s] [eta 00m:03s]
Threads: 2: [VVE] [95.2% done] [ 35810/     0 kb/s] [eta 00m:01s]
Threads: 2: [VV_] [100.0% done] [ 34560/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [100.0% done] [ 31840/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5847
  read : io=100MiB, bw=4,483KiB/s, runt= 23390msec
    slat (msec): min=   65, max=20755, avg=17372.58, stdev=4279.97
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=35128, per=79.81%, avg=10733.24, stdev=9007.39
  write: io=95,904KiB, bw=6,281KiB/s, runt= 15634msec
    slat (msec): min=    0, max=  100, avg= 1.96, stdev= 5.14
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=92504, per=167.34%, avg=30975.00, stdev=53286.09
  cpu          : usr=5.27%, sys=1.54%, ctx=878
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5848
  read : io=100MiB, bw=4,575KiB/s, runt= 22916msec
    slat (msec): min=   49, max=19436, avg=14961.72, stdev=5435.48
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=22248, per=76.77%, avg=10324.61, stdev=7234.93
  write: io=90,404KiB, bw=5,916KiB/s, runt= 15646msec
    slat (msec): min=    0, max=  105, avg= 2.21, stdev= 5.18
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=91196, per=164.41%, avg=30432.67, stdev=52622.61
  cpu          : usr=5.31%, sys=1.47%, ctx=1061
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5849
  read : io=100MiB, bw=5,208KiB/s, runt= 20133msec
    slat (msec): min=  103, max=18111, avg=13612.09, stdev=3369.03
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=18768, per=71.24%, avg=9581.50, stdev=5141.62
  write: io=96,512KiB, bw=9,020KiB/s, runt= 10956msec
    slat (msec): min=    0, max=   11, avg= 1.77, stdev= 2.00
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=52748, per=142.49%, avg=26374.00, stdev=37298.47
  cpu          : usr=6.24%, sys=1.99%, ctx=878
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,449KiB/s, minb=4,483KiB/s, maxb=5,208KiB/s, mint=20133msec, maxt=23390msec
  WRITE: io=276MiB, aggrb=18,510KiB/s, minb=5,916KiB/s, maxb=9,020KiB/s, mint=20133msec, maxt=23390msec

Disk stats (read/write):
  sda: ios=3397/1742, merge=1198/68994, ticks=64496/1848036, in_queue=1912532, util=99.00%
3.76user 1.10system 0:23.80elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2407minor)pagefaults 0swaps