fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [10.7% done] [ 17501/  5140 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [14.8% done] [ 13161/  6721 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [16.7% done] [  8094/  8659 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [18.2% done] [  9914/  5619 kb/s] [eta 00m:27s]
Threads: 3: [mmm] [20.0% done] [ 10674/  5640 kb/s] [eta 00m:28s]
Threads: 3: [mmm] [24.2% done] [ 14193/  5209 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [26.5% done] [  9921/  6829 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [30.3% done] [ 15208/  1900 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [31.4% done] [ 10800/  3848 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [32.4% done] [  4504/  8940 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [33.3% done] [  5468/  7208 kb/s] [eta 00m:26s]
Threads: 3: [mmm] [35.0% done] [  6936/  4564 kb/s] [eta 00m:26s]
Threads: 3: [mmm] [39.5% done] [  9652/  3620 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [40.0% done] [  7668/  2064 kb/s] [eta 00m:24s]
Threads: 3: [mmV] [41.5% done] [ 10960/     0 kb/s] [eta 00m:24s]
Threads: 3: [mVV] [41.9% done] [ 18168/     0 kb/s] [eta 00m:25s]
Threads: 3: [mVV] [42.2% done] [ 18040/     0 kb/s] [eta 00m:26s]
Threads: 3: [mVV] [43.5% done] [ 16984/     0 kb/s] [eta 00m:26s]
Threads: 3: [mVV] [43.8% done] [ 17480/     0 kb/s] [eta 00m:27s]
Threads: 1: [m__] [51.2% done] [ 16276/     0 kb/s] [eta 00m:21s]
Threads: 1: [m__] [59.0% done] [  6532/  6396 kb/s] [eta 00m:16s]
Threads: 1: [m__] [66.7% done] [  4616/  5600 kb/s] [eta 00m:12s]
Threads: 1: [V__] [75.8% done] [ 13992/     0 kb/s] [eta 00m:08s]
fio: (groupid=0): err= 0: pid=5152
  read : io=100MiB, bw=4,058KiB/s, runt= 25839msec
    slat (msec): min=    0, max= 1357, avg=178.20, stdev=350.46
    clat (msec): min=    1, max= 1286, avg=96.99, stdev=182.39
    bw (KiB/s) : min=  488, max=14389, per=35.09%, avg=4271.27, stdev=4251.55
  write: io=20,304KiB, bw=846KiB/s, runt= 24575msec
    slat (msec): min=    0, max=    1, avg= 0.00, stdev= 0.07
    clat (msec): min=    0, max=  867, avg=91.41, stdev=215.46
    bw (KiB/s) : min=    0, max=12327, per=69.37%, avg=2724.17, stdev=4095.24
  cpu          : usr=3.53%, sys=0.17%, ctx=2013
  IO depths    : 1=0.1%, 2=0.2%, 4=1.6%, 8=98.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=10.3%, 4=2.1%, 10=13.7%, 20=21.1%, 50=24.3%, 100=10.0%
     lat (msec): 250=6.0%, 500=6.5%, 750=2.8%, 1000=3.0%, >=2000=0.1%
fio: (groupid=0): err= 0: pid=5153
  read : io=100MiB, bw=4,798KiB/s, runt= 21850msec
    slat (msec): min=    0, max= 4271, avg=745.80, stdev=1283.82
    clat (msec): min=    1, max=  719, avg=73.60, stdev=92.83
    bw (KiB/s) : min=  163, max=10459, per=42.13%, avg=5129.11, stdev=3214.18
  write: io=35,792KiB, bw=2,119KiB/s, runt= 17292msec
    slat (msec): min=    0, max=    1, avg= 0.00, stdev= 0.06
    clat (msec): min=    0, max=  831, avg=89.39, stdev=151.80
    bw (KiB/s) : min=    0, max= 9305, per=87.87%, avg=3450.63, stdev=2840.74
  cpu          : usr=3.94%, sys=0.29%, ctx=2020
  IO depths    : 1=0.1%, 2=0.2%, 4=4.3%, 8=95.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=8.8%, 4=1.9%, 10=8.7%, 20=17.3%, 50=21.7%, 100=15.7%
     lat (msec): 250=19.3%, 500=4.9%, 750=1.4%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5154
  read : io=100MiB, bw=4,712KiB/s, runt= 22253msec
    slat (msec): min=    0, max= 5232, avg=1022.88, stdev=1513.33
    clat (msec): min=    1, max= 1034, avg=73.07, stdev=103.01
    bw (KiB/s) : min=  226, max=14082, per=41.67%, avg=5072.84, stdev=3611.75
  write: io=38,160KiB, bw=2,376KiB/s, runt= 16443msec
    slat (msec): min=    0, max=    1, avg= 0.00, stdev= 0.06
    clat (msec): min=    0, max=  830, avg=76.52, stdev=136.28
    bw (KiB/s) : min=    0, max= 9347, per=80.33%, avg=3154.61, stdev=2998.96
  cpu          : usr=3.99%, sys=0.32%, ctx=2109
  IO depths    : 1=0.1%, 2=0.3%, 4=4.8%, 8=94.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=10.3%, 4=1.7%, 10=9.8%, 20=15.9%, 50=22.6%, 100=15.5%
     lat (msec): 250=17.5%, 500=5.2%, 750=0.8%, 1000=0.4%, >=2000=0.1%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,174KiB/s, minb=4,058KiB/s, maxb=4,798KiB/s, mint=21850msec, maxt=25839msec
  WRITE: io=94,256KiB, aggrb=3,927KiB/s, minb=846KiB/s, maxb=2,376KiB/s, mint=21850msec, maxt=25839msec

Disk stats (read/write):
  sda: ios=5440/1925, merge=1157/152, ticks=444224/153424, in_queue=597648, util=98.55%
2.71user 0.30system 0:26.40elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2383minor)pagefaults 0swaps