fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [6.4% done] [ 14270/  7090 kb/s] [eta 00m:44s]
Threads: 3: [mmm] [7.3% done] [  1950/ 14356 kb/s] [eta 00m:51s]
Threads: 3: [mmm] [8.6% done] [  7684/  9825 kb/s] [eta 00m:53s]
Threads: 3: [mmm] [10.2% done] [  4254/ 11394 kb/s] [eta 00m:53s]
Threads: 3: [mmm] [14.0% done] [ 16087/   902 kb/s] [eta 00m:43s]
Threads: 3: [mmm] [17.0% done] [ 14791/  3998 kb/s] [eta 00m:39s]
Threads: 3: [mmm] [21.4% done] [  5636/ 10300 kb/s] [eta 00m:33s]
Threads: 3: [mmm] [22.7% done] [  7960/  6859 kb/s] [eta 00m:34s]
Threads: 3: [mmm] [25.0% done] [  3080/ 11361 kb/s] [eta 00m:33s]
Threads: 3: [mmm] [26.7% done] [ 10162/  3474 kb/s] [eta 00m:33s]
Threads: 3: [mmm] [28.3% done] [ 14067/     0 kb/s] [eta 00m:33s]
Threads: 3: [mmm] [30.4% done] [ 10122/  2608 kb/s] [eta 00m:32s]
Threads: 3: [mmV] [34.9% done] [  2304/ 10552 kb/s] [eta 00m:28s]
Threads: 3: [mmV] [35.6% done] [ 14583/  1783 kb/s] [eta 00m:29s]
Threads: 3: [mmV] [37.0% done] [ 12865/  3023 kb/s] [eta 00m:29s]
Threads: 3: [mmV] [37.5% done] [ 11398/  3246 kb/s] [eta 00m:30s]
Threads: 3: [mVV] [38.8% done] [ 15197/   524 kb/s] [eta 00m:30s]
Threads: 2: [mVE] [39.2% done] [ 16928/     0 kb/s] [eta 00m:31s]
Threads: 2: [mV_] [40.4% done] [ 16798/     0 kb/s] [eta 00m:31s]
Threads: 1: [m__] [45.8% done] [ 16631/     0 kb/s] [eta 00m:26s]
Threads: 1: [m__] [54.8% done] [ 11158/  2893 kb/s] [eta 00m:19s]
Threads: 1: [m__] [63.2% done] [  6107/  6204 kb/s] [eta 00m:14s]
Threads: 1: [V__] [71.4% done] [  4372/  6562 kb/s] [eta 00m:10s]
Threads: 1: [V__] [83.9% done] [ 19191/     0 kb/s] [eta 00m:05s]
fio: (groupid=0): err= 0: pid=1255
  read : io=100MiB, bw=3,892KiB/s, runt= 26941msec
    slat (msec): min=    0, max= 2467, avg=556.03, stdev=735.04
    clat (msec): min=    0, max= 1325, avg=88.50, stdev=187.02
    bw (KiB/s) : min=    4, max=20496, per=43.66%, avg=5098.24, stdev=6225.42
  write: io=38,076KiB, bw=1,572KiB/s, runt= 24796msec
    slat (msec): min=    0, max=    1, avg= 0.01, stdev= 0.09
    clat (msec): min=    0, max= 1106, avg=86.89, stdev=203.13
    bw (KiB/s) : min=    0, max=13669, per=57.41%, avg=2786.50, stdev=3757.40
  cpu          : usr=3.49%, sys=0.30%, ctx=2164
  IO depths    : 1=0.2%, 2=0.4%, 4=2.8%, 8=96.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=14.3%, 4=2.0%, 10=14.6%, 20=21.5%, 50=22.7%, 100=8.6%
     lat (msec): 250=5.8%, 500=3.9%, 750=2.9%, 1000=3.2%, >=2000=0.2%
fio: (groupid=0): err= 0: pid=1256
  read : io=100MiB, bw=4,872KiB/s, runt= 21521msec
    slat (msec): min=    0, max= 2930, avg=638.51, stdev=936.95
    clat (msec): min=    0, max= 1141, avg=65.71, stdev=96.81
    bw (KiB/s) : min=  222, max=17342, per=48.22%, avg=5629.64, stdev=4452.55
  write: io=35,376KiB, bw=1,946KiB/s, runt= 18612msec
    slat (msec): min=    0, max=  445, avg= 0.73, stdev=17.58
    clat (msec): min=    0, max= 1402, avg=84.38, stdev=148.61
    bw (KiB/s) : min=    0, max= 8078, per=62.10%, avg=3014.50, stdev=2821.04
  cpu          : usr=3.96%, sys=0.48%, ctx=2106
  IO depths    : 1=0.2%, 2=0.6%, 4=4.0%, 8=95.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=7.1%, 4=1.8%, 10=10.8%, 20=18.7%, 50=24.7%, 100=15.4%
     lat (msec): 250=15.7%, 500=4.5%, 750=0.6%, 1000=0.5%, >=2000=0.1%
fio: (groupid=0): err= 0: pid=1257
  read : io=100MiB, bw=5,279KiB/s, runt= 19863msec
    slat (msec): min=    0, max= 5594, avg=1140.90, stdev=1715.40
    clat (msec): min=    1, max=  769, avg=66.31, stdev=79.13
    bw (KiB/s) : min=   42, max=14149, per=52.86%, avg=6172.44, stdev=3703.65
  write: io=44,092KiB, bw=3,015KiB/s, runt= 14975msec
    slat (msec): min=    0, max=  108, avg= 0.19, stdev= 4.33
    clat (msec): min=    0, max=  847, avg=72.04, stdev=138.98
    bw (KiB/s) : min=    0, max=16278, per=103.38%, avg=5017.88, stdev=4851.54
  cpu          : usr=4.57%, sys=0.42%, ctx=2121
  IO depths    : 1=0.1%, 2=0.3%, 4=4.1%, 8=95.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=10.4%, 4=1.1%, 10=8.1%, 20=15.4%, 50=26.9%, 100=16.4%
     lat (msec): 250=16.7%, 500=3.9%, 750=0.6%, 1000=0.4%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,676KiB/s, minb=3,892KiB/s, maxb=5,279KiB/s, mint=19863msec, maxt=26941msec
  WRITE: io=115MiB, aggrb=4,854KiB/s, minb=1,572KiB/s, maxb=3,015KiB/s, mint=19863msec, maxt=26941msec

Disk stats (read/write):
  sda: ios=5487/2441, merge=1031/229, ticks=386748/193468, in_queue=580212, util=99.18%
2.75user 0.37system 0:27.26elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2398minor)pagefaults 0swaps