fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [6.7% done] [ 10996/ 56708 kb/s] [eta 00m:42s]
Threads: 3: [mmF] [9.3% done] [  9292/ 34364 kb/s] [eta 00m:39s]
Threads: 3: [mmF] [50.0% done] [  5608/ 56740 kb/s] [eta 00m:05s]
Threads: 3: [mmF] [50.0% done] [  8356/     0 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [63.6% done] [  3956/ 40348 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [     0/  6844 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [   992/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [68.0% done] [ 14912/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 28428/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 21936/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 27564/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [91.3% done] [ 33180/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.7% done] [ 30336/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 29660/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33236/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 26954/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=16462
  read : io=100MiB, bw=4,100KiB/s, runt= 25575msec
    slat (msec): min=   34, max=18470, avg=12778.89, stdev=5862.77
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=22542, per=52.10%, avg=6408.62, stdev=5296.23
  write: io=79,892KiB, bw=5,110KiB/s, runt= 16009msec
    slat (msec): min=    0, max=  105, avg= 2.22, stdev= 7.53
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=96996, per=202.11%, avg=32394.67, stdev=55946.47
  cpu          : usr=4.41%, sys=1.42%, ctx=1041
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16463
  read : io=100MiB, bw=4,249KiB/s, runt= 24673msec
    slat (msec): min=   44, max=18108, avg=11714.79, stdev=6176.72
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=16991, per=55.59%, avg=6837.36, stdev=4789.99
  write: io=79,968KiB, bw=5,116KiB/s, runt= 16004msec
    slat (msec): min=    0, max=  337, avg= 2.26, stdev=13.22
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=68894, per=143.37%, avg=22980.00, stdev=39762.70
  cpu          : usr=4.26%, sys=1.33%, ctx=1124
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16464
  read : io=100MiB, bw=4,119KiB/s, runt= 25456msec
    slat (msec): min=   26, max=21869, avg=16621.32, stdev=4919.33
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=22804, per=65.56%, avg=8063.82, stdev=5632.59
  write: io=90,720KiB, bw=5,806KiB/s, runt= 16000msec
    slat (msec): min=    0, max=   30, avg= 1.76, stdev= 2.34
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111147, per=232.60%, avg=37281.67, stdev=63970.21
  cpu          : usr=4.59%, sys=1.45%, ctx=894
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,300KiB/s, minb=4,100KiB/s, maxb=4,249KiB/s, mint=24673msec, maxt=25575msec
  WRITE: io=245MiB, aggrb=16,028KiB/s, minb=5,110KiB/s, maxb=5,806KiB/s, mint=24673msec, maxt=25575msec

Disk stats (read/write):
  sda: ios=3867/1855, merge=1483/60776, ticks=94376/1868764, in_queue=1963140, util=99.17%
3.40user 1.08system 0:25.87elapsed 17%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2420minor)pagefaults 0swaps