fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [7.5% done] [  2996/     0 kb/s] [eta 00m:37s]
Threads: 3: [mmm] [8.2% done] [  3000/ 14112 kb/s] [eta 00m:45s]
Threads: 3: [mFF] [9.4% done] [  2812/ 74888 kb/s] [eta 00m:48s]
Threads: 3: [mFF] [10.5% done] [  1796/     0 kb/s] [eta 00m:51s]
Threads: 3: [FFF] [100.0% done] [  2712/ 83560 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.0% done] [  3084/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 21320/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [76.0% done] [ 29084/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [87.0% done] [ 37044/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [91.3% done] [ 35640/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.7% done] [ 26952/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 26008/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32092/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32952/     0 kb/s] [eta 00m:00s]
Threads: 1: [_V_] [100.0% done] [ 30608/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5126
  read : io=100MiB, bw=3,978KiB/s, runt= 26355msec
    slat (msec): min=   64, max=19404, avg=13755.86, stdev=5033.34
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    8, max=12533, per=56.37%, avg=6688.60, stdev=3913.37
  write: io=83,560KiB, bw=5,048KiB/s, runt= 16949msec
    slat (msec): min=    0, max=   11, avg= 1.65, stdev= 1.78
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=118341, per=354.14%, avg=59170.50, stdev=83679.72
  cpu          : usr=4.45%, sys=1.27%, ctx=1123
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5127
  read : io=100MiB, bw=3,955KiB/s, runt= 26512msec
    slat (msec): min=   11, max=22175, avg=17559.29, stdev=4242.38
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    8, max=16554, per=63.80%, avg=7570.05, stdev=5682.30
  write: io=95,984KiB, bw=5,800KiB/s, runt= 16945msec
    slat (msec): min=    0, max=   17, avg= 1.91, stdev= 2.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=16124, per=48.25%, avg=8062.00, stdev=11401.39
  cpu          : usr=4.65%, sys=1.30%, ctx=1006
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5128
  read : io=100MiB, bw=3,981KiB/s, runt= 26337msec
    slat (msec): min=  191, max=22107, avg=17021.94, stdev=4252.76
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   15, max=14887, per=68.84%, avg=8168.11, stdev=5597.35
  write: io=97,016KiB, bw=5,864KiB/s, runt= 16941msec
    slat (msec): min=    0, max=  345, avg= 2.47, stdev=12.53
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=62294, per=124.44%, avg=20791.67, stdev=35942.10
  cpu          : usr=4.47%, sys=1.58%, ctx=931
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,865KiB/s, minb=3,955KiB/s, maxb=3,981KiB/s, mint=26337msec, maxt=26512msec
  WRITE: io=270MiB, aggrb=16,708KiB/s, minb=5,048KiB/s, maxb=5,864KiB/s, mint=26337msec, maxt=26512msec

Disk stats (read/write):
  sda: ios=3442/2269, merge=1374/66827, ticks=141580/2009112, in_queue=2151492, util=98.78%
3.63user 1.17system 0:26.91elapsed 17%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2430minor)pagefaults 0swaps