fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [5.7% done] [   956/ 18728 kb/s] [eta 00m:50s]
Threads: 3: [FFm] [6.7% done] [  1164/     0 kb/s] [eta 00m:56s]
Threads: 3: [FFm] [8.3% done] [  1344/     0 kb/s] [eta 00m:55s]
Threads: 3: [FFm] [10.0% done] [  1792/     0 kb/s] [eta 00m:54s]
Threads: 3: [FFm] [11.7% done] [  1124/     0 kb/s] [eta 00m:53s]
Threads: 3: [FFm] [13.3% done] [  2160/     0 kb/s] [eta 00m:52s]
Threads: 3: [FFm] [15.0% done] [   848/     0 kb/s] [eta 00m:51s]
Threads: 3: [FFm] [16.7% done] [   892/     0 kb/s] [eta 00m:50s]
Threads: 3: [FFm] [18.3% done] [  2076/     0 kb/s] [eta 00m:49s]
Threads: 3: [VVm] [50.0% done] [ 21112/ 53116 kb/s] [eta 00m:12s]
Threads: 3: [VVF] [81.2% done] [ 27460/ 28208 kb/s] [eta 00m:03s]
Threads: 3: [VVF] [93.3% done] [ 30348/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVF] [100.0% done] [ 28852/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVF] [100.0% done] [ 28608/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVF] [100.0% done] [ 22180/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVF] [100.0% done] [ 26460/     0 kb/s] [eta 00m:00s]
Threads: 1: [__F] [100.0% done] [ 17568/     0 kb/s] [eta 00m:00s]
Threads: 1: [__F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [67.7% done] [     0/     0 kb/s] [eta 00m:10s]
Threads: 1: [__V] [84.6% done] [ 24972/     0 kb/s] [eta 00m:04s]
Threads: 1: [__V] [100.0% done] [ 27960/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=4770
  read : io=100MiB, bw=5,722KiB/s, runt= 18323msec
    slat (msec): min=10706, max=17380, avg=14253.48, stdev=1875.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=22657, per=111.94%, avg=14421.77, stdev=5400.88
  write: io=100MiB, bw=9,234KiB/s, runt= 11355msec
    slat (msec): min=    0, max=   15, avg= 2.04, stdev= 2.14
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112865, per=412.10%, avg=56432.50, stdev=79807.61
  cpu          : usr=7.07%, sys=2.10%, ctx=804
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4771
  read : io=100MiB, bw=5,514KiB/s, runt= 19016msec
    slat (msec): min=  165, max=16946, avg=13062.45, stdev=2950.62
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   25, max=22792, per=87.77%, avg=11308.40, stdev=6739.57
  write: io=99,052KiB, bw=8,938KiB/s, runt= 11347msec
    slat (msec): min=    0, max=   17, avg= 1.94, stdev= 2.19
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=49073, per=179.18%, avg=24536.50, stdev=34699.85
  cpu          : usr=6.46%, sys=2.23%, ctx=933
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4772
  read : io=100MiB, bw=4,294KiB/s, runt= 24414msec
    slat (msec): min=   59, max=11676, avg=9303.19, stdev=3139.28
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    2, max=35482, per=59.86%, avg=7712.27, stdev=11557.48
  write: io=81,324KiB, bw=3,938KiB/s, runt= 21145msec
    slat (msec): min=    0, max=  656, avg= 3.04, stdev=29.92
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=47783, per=174.47%, avg=23891.50, stdev=33787.68
  cpu          : usr=4.80%, sys=1.47%, ctx=1247
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,884KiB/s, minb=4,294KiB/s, maxb=5,722KiB/s, mint=18323msec, maxt=24414msec
  WRITE: io=276MiB, aggrb=13,694KiB/s, minb=3,938KiB/s, maxb=9,234KiB/s, mint=18323msec, maxt=24414msec

Disk stats (read/write):
  sda: ios=3279/2113, merge=1347/68160, ticks=72180/2540000, in_queue=2641304, util=97.67%
3.73user 1.18system 0:24.82elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps