fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [6.8% done] [  2016/ 16712 kb/s] [eta 00m:41s]
Threads: 3: [FmF] [7.7% done] [  1240/ 24776 kb/s] [eta 00m:48s]
Threads: 3: [FmF] [8.9% done] [  1884/     0 kb/s] [eta 00m:51s]
Threads: 3: [FmF] [10.0% done] [  1040/     0 kb/s] [eta 00m:54s]
Threads: 3: [FmF] [50.0% done] [  1152/ 57448 kb/s] [eta 00m:07s]
Threads: 3: [FFF] [100.0% done] [   444/ 28736 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.6% done] [  4136/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [70.8% done] [ 29004/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.0% done] [ 34788/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 22696/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [83.3% done] [ 32099/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [91.3% done] [ 34028/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 30828/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30652/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 36616/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=13544
  read : io=100MiB, bw=4,162KiB/s, runt= 25192msec
    slat (msec): min=  108, max=23579, avg=20464.08, stdev=3582.63
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=33209, per=73.60%, avg=9190.59, stdev=8235.18
  write: io=98MiB, bw=6,631KiB/s, runt= 15482msec
    slat (msec): min=    0, max=  151, avg= 2.02, stdev= 4.30
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=86815, per=154.87%, avg=28987.67, stdev=50079.99
  cpu          : usr=5.08%, sys=1.27%, ctx=865
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13545
  read : io=100MiB, bw=4,263KiB/s, runt= 24593msec
    slat (msec): min=   78, max=17111, avg=11630.49, stdev=4111.49
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=18807, per=59.14%, avg=7385.41, stdev=5769.95
  write: io=86,184KiB, bw=5,693KiB/s, runt= 15501msec
    slat (msec): min=    0, max=  177, avg= 2.09, stdev=10.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=87759, per=163.50%, avg=30604.67, stdev=49538.61
  cpu          : usr=4.88%, sys=1.35%, ctx=1061
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13546
  read : io=100MiB, bw=4,265KiB/s, runt= 24581msec
    slat (msec): min=  119, max=21426, avg=16684.43, stdev=3976.52
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=20488, per=71.38%, avg=8913.78, stdev=6313.47
  write: io=96,920KiB, bw=6,404KiB/s, runt= 15497msec
    slat (msec): min=    0, max=   12, avg= 1.67, stdev= 1.84
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=25171, per=67.24%, avg=12585.50, stdev=17798.58
  cpu          : usr=5.26%, sys=1.20%, ctx=1093
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,487KiB/s, minb=4,162KiB/s, maxb=4,265KiB/s, mint=24581msec, maxt=25192msec
  WRITE: io=277MiB, aggrb=18,718KiB/s, minb=5,693KiB/s, maxb=6,631KiB/s, mint=24581msec, maxt=25192msec

Disk stats (read/write):
  sda: ios=3297/2144, merge=1467/68515, ticks=93024/1972152, in_queue=2069316, util=99.07%
3.82user 1.00system 0:25.50elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2423minor)pagefaults 0swaps