fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [25.0% done] [    64/114451 kb/s] [eta 00m:09s]
Threads: 3: [mmF] [28.6% done] [  5804/   208 kb/s] [eta 00m:10s]
Threads: 3: [mmF] [33.3% done] [  6228/  4612 kb/s] [eta 00m:10s]
Threads: 3: [mFF] [66.7% done] [   356/ 54216 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [   640/  1032 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [     0/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [68.0% done] [ 23320/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [75.0% done] [ 27744/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [79.2% done] [ 28960/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.0% done] [ 30680/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [91.3% done] [ 33444/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 32952/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 28108/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33632/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 32332/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=13534
  read : io=100MiB, bw=4,103KiB/s, runt= 25551msec
    slat (msec): min=  104, max=18761, avg=13667.96, stdev=5050.85
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=18677, per=55.35%, avg=6814.04, stdev=5706.41
  write: io=86,340KiB, bw=5,529KiB/s, runt= 15989msec
    slat (msec): min=    0, max=  668, avg= 4.41, stdev=33.13
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=73749, per=114.42%, avg=20033.20, stdev=32067.20
  cpu          : usr=5.37%, sys=1.44%, ctx=1076
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13535
  read : io=100MiB, bw=4,236KiB/s, runt= 24753msec
    slat (msec): min=   21, max=19475, avg=12894.08, stdev=5916.92
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   18, max=22567, per=62.66%, avg=7714.04, stdev=6089.62
  write: io=88,180KiB, bw=5,637KiB/s, runt= 16017msec
    slat (msec): min=    0, max=  105, avg= 3.04, stdev= 7.47
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=90791, per=223.81%, avg=39187.25, stdev=46338.17
  cpu          : usr=5.37%, sys=1.76%, ctx=1164
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13536
  read : io=100MiB, bw=4,151KiB/s, runt= 25260msec
    slat (msec): min=   82, max=23205, avg=18786.66, stdev=3959.10
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=20568, per=75.74%, avg=9324.06, stdev=6288.35
  write: io=99,364KiB, bw=6,366KiB/s, runt= 15981msec
    slat (msec): min=    0, max=   83, avg= 2.05, stdev= 5.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=95613, per=182.32%, avg=31923.00, stdev=55157.21
  cpu          : usr=4.78%, sys=1.44%, ctx=836
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,311KiB/s, minb=4,103KiB/s, maxb=4,236KiB/s, mint=24753msec, maxt=25551msec
  WRITE: io=267MiB, aggrb=17,509KiB/s, minb=5,529KiB/s, maxb=6,366KiB/s, mint=24753msec, maxt=25551msec

Disk stats (read/write):
  sda: ios=3645/2213, merge=1332/66169, ticks=69048/1926280, in_queue=1997448, util=97.86%
3.95user 1.19system 0:25.90elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2417minor)pagefaults 0swaps