fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [7.7% done] [  7428/ 44181 kb/s] [eta 00m:36s]
Threads: 3: [mmF] [8.5% done] [  2477/ 38817 kb/s] [eta 00m:43s]
Threads: 3: [mmF] [10.0% done] [  2981/     0 kb/s] [eta 00m:45s]
Threads: 3: [mmF] [10.5% done] [  1748/     0 kb/s] [eta 00m:51s]
Threads: 3: [mmF] [11.7% done] [  1965/     0 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [13.3% done] [  2087/ 33315 kb/s] [eta 00m:52s]
Threads: 3: [mFF] [15.0% done] [  2504/     0 kb/s] [eta 00m:51s]
Threads: 3: [FFF] [100.0% done] [     0/ 79765 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVF] [66.7% done] [     0/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [67.9% done] [ 13233/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [69.0% done] [ 29270/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [72.4% done] [ 28033/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [78.6% done] [ 25263/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [85.2% done] [ 31873/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [92.3% done] [ 30239/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 34072/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35564/     0 kb/s] [eta 00m:00s]
Threads: 1: [V_E] [100.0% done] [ 30960/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5147
  read : io=100MiB, bw=3,742KiB/s, runt= 28020msec
    slat (msec): min=  179, max=18109, avg=13732.83, stdev=4842.79
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=17117, per=53.75%, avg=6033.76, stdev=4905.90
  write: io=81,012KiB, bw=4,480KiB/s, runt= 18515msec
    slat (msec): min=    0, max=    8, avg= 1.46, stdev= 1.61
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=118882, per=404.03%, avg=59441.00, stdev=84062.27
  cpu          : usr=3.91%, sys=1.23%, ctx=1131
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5148
  read : io=100MiB, bw=3,870KiB/s, runt= 27093msec
    slat (msec): min=   91, max=19383, avg=13707.94, stdev=4807.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=16453, per=60.59%, avg=6801.50, stdev=5387.60
  write: io=89,972KiB, bw=4,974KiB/s, runt= 18519msec
    slat (msec): min=    0, max=   10, avg= 1.69, stdev= 1.92
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=10279, per=34.93%, avg=5139.50, stdev=7268.35
  cpu          : usr=4.40%, sys=1.14%, ctx=1112
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5149
  read : io=100MiB, bw=3,759KiB/s, runt= 27893msec
    slat (msec): min=  103, max=23988, avg=19102.29, stdev=5131.83
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=20447, per=74.92%, avg=8410.60, stdev=5694.59
  write: io=95,128KiB, bw=5,259KiB/s, runt= 18522msec
    slat (msec): min=    0, max=   11, avg= 1.67, stdev= 1.84
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=19164, per=65.13%, avg=9582.00, stdev=13550.99
  cpu          : usr=4.35%, sys=1.16%, ctx=1040
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,226KiB/s, minb=3,742KiB/s, maxb=3,870KiB/s, mint=27093msec, maxt=28020msec
  WRITE: io=260MiB, aggrb=14,712KiB/s, minb=4,480KiB/s, maxb=5,259KiB/s, mint=27093msec, maxt=28020msec

Disk stats (read/write):
  sda: ios=3638/2418, merge=1375/64031, ticks=115168/2250432, in_queue=2366128, util=99.04%
3.55user 1.00system 0:28.44elapsed 16%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2433minor)pagefaults 0swaps