fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [75.0% done] [  1432/128152 kb/s] [eta 00m:01s]
Threads: 3: [FFF] [100.0% done] [     0/  8272 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  8608/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 21472/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [77.3% done] [ 31260/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [81.8% done] [ 29700/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [95.0% done] [ 34036/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35995/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32248/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37764/     0 kb/s] [eta 00m:00s]
Threads: 2: [VEV] [100.0% done] [ 36076/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=13150
  read : io=100MiB, bw=4,370KiB/s, runt= 23990msec
    slat (msec): min=  300, max=22453, avg=18678.70, stdev=3032.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=16458, per=73.18%, avg=9559.60, stdev=5182.85
  write: io=99,852KiB, bw=7,007KiB/s, runt= 14592msec
    slat (msec): min=    0, max=   16, avg= 1.89, stdev= 2.03
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112241, per=276.99%, avg=56120.50, stdev=79366.37
  cpu          : usr=5.20%, sys=1.35%, ctx=831
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13151
  read : io=100MiB, bw=4,481KiB/s, runt= 23399msec
    slat (msec): min=   74, max=20405, avg=15368.95, stdev=4352.38
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=15582, per=70.92%, avg=9265.00, stdev=4412.27
  write: io=92,060KiB, bw=6,451KiB/s, runt= 14613msec
    slat (msec): min=    0, max=   12, avg= 1.86, stdev= 1.98
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=113257, per=279.50%, avg=56628.50, stdev=80084.79
  cpu          : usr=5.28%, sys=1.64%, ctx=994
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13152
  read : io=100MiB, bw=4,354KiB/s, runt= 24078msec
    slat (msec): min=  123, max=21395, avg=17252.14, stdev=3891.68
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=19433, per=65.79%, avg=8594.94, stdev=5632.02
  write: io=97,548KiB, bw=6,828KiB/s, runt= 14629msec
    slat (msec): min=    0, max=   15, avg= 1.81, stdev= 1.96
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=31959, per=78.87%, avg=15979.50, stdev=22598.43
  cpu          : usr=5.23%, sys=1.40%, ctx=1067
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,064KiB/s, minb=4,354KiB/s, maxb=4,481KiB/s, mint=23399msec, maxt=24078msec
  WRITE: io=283MiB, aggrb=20,261KiB/s, minb=6,451KiB/s, maxb=7,007KiB/s, mint=23399msec, maxt=24078msec

Disk stats (read/write):
  sda: ios=3137/2159, merge=1307/69990, ticks=94284/1857324, in_queue=1952992, util=98.95%
3.81user 1.04system 0:24.40elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2419minor)pagefaults 0swaps