fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.1% done] [ 15067/  5319 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [14.3% done] [  9020/  9390 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [18.5% done] [ 14498/  2551 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [22.2% done] [ 12064/  6334 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [25.0% done] [  4981/ 10183 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [28.6% done] [  7749/  5436 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [32.1% done] [ 11706/  5461 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [35.7% done] [  9931/  5965 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [37.9% done] [ 14108/  1223 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [41.4% done] [  7501/  6753 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [43.3% done] [  7444/  5729 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [46.7% done] [  7127/  7074 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [50.0% done] [  5152/  7651 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [53.3% done] [ 10498/  1110 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [54.8% done] [  9918/  2113 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [58.1% done] [  9150/  2121 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [61.3% done] [  7330/  3328 kb/s] [eta 00m:12s]
Threads: 3: [mVm] [62.5% done] [  9016/   308 kb/s] [eta 00m:12s]
Threads: 3: [mVm] [63.6% done] [ 14709/   861 kb/s] [eta 00m:12s]
Threads: 3: [mVm] [64.7% done] [ 14181/  1328 kb/s] [eta 00m:12s]
Threads: 3: [mVm] [65.7% done] [ 16249/   893 kb/s] [eta 00m:12s]
Threads: 2: [V_V] [66.7% done] [ 10849/     0 kb/s] [eta 00m:12s]
Threads: 2: [V_V] [73.5% done] [ 18291/     0 kb/s] [eta 00m:09s]
Threads: 2: [V_V] [78.8% done] [ 20484/     0 kb/s] [eta 00m:07s]
Threads: 1: [__V] [84.4% done] [ 18362/     0 kb/s] [eta 00m:05s]
fio: (groupid=0): err= 0: pid=28323
  read : io=100MiB, bw=3,882KiB/s, runt= 27008msec
    slat (msec): min=    0, max= 3196, avg=478.95, stdev=901.91
    clat (msec): min=    3, max=  831, avg=96.28, stdev=98.80
    bw (KiB/s) : min=   40, max=14189, per=36.23%, avg=4124.58, stdev=3366.84
  write: io=31,316KiB, bw=1,346KiB/s, runt= 23809msec
    slat (msec): min=    0, max=    3, avg= 0.06, stdev= 0.32
    clat (msec): min=    0, max=  767, avg=117.02, stdev=117.41
    bw (KiB/s) : min=    0, max=10078, per=58.35%, avg=2787.39, stdev=2580.55
  cpu          : usr=3.61%, sys=0.16%, ctx=1794
  IO depths    : 1=0.1%, 2=0.2%, 4=10.6%, 8=89.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.2%, 4=0.3%, 10=3.1%, 20=12.8%, 50=22.0%, 100=21.6%
     lat (msec): 250=31.3%, 500=6.6%, 750=0.4%, 1000=0.4%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=28324
  read : io=100MiB, bw=4,484KiB/s, runt= 23381msec
    slat (msec): min=    0, max= 3412, avg=600.27, stdev=1021.89
    clat (msec): min=    3, max=  605, avg=72.40, stdev=60.60
    bw (KiB/s) : min=    9, max=19191, per=47.62%, avg=5420.69, stdev=4536.04
  write: io=44,324KiB, bw=2,271KiB/s, runt= 19978msec
    slat (msec): min=    0, max=    7, avg= 0.17, stdev= 0.72
    clat (msec): min=    0, max=  829, avg=127.66, stdev=130.30
    bw (KiB/s) : min=    0, max= 6711, per=70.73%, avg=3378.62, stdev=2176.38
  cpu          : usr=4.21%, sys=0.36%, ctx=1756
  IO depths    : 1=0.1%, 2=0.2%, 4=12.8%, 8=86.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.8%, 4=0.4%, 10=3.5%, 20=10.3%, 50=26.4%, 100=26.9%
     lat (msec): 250=27.6%, 500=3.0%, 750=0.9%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=28325
  read : io=100MiB, bw=3,794KiB/s, runt= 27635msec
    slat (msec): min=    0, max= 5584, avg=1280.99, stdev=1959.68
    clat (msec): min=    2, max=  625, avg=89.45, stdev=75.39
    bw (KiB/s) : min=   25, max=12754, per=37.34%, avg=4250.14, stdev=3032.49
  write: io=35,440KiB, bw=1,587KiB/s, runt= 22858msec
    slat (msec): min=    0, max=    7, avg= 0.09, stdev= 0.56
    clat (msec): min=    0, max=  879, avg=115.35, stdev=135.85
    bw (KiB/s) : min=    0, max=14560, per=62.70%, avg=2995.05, stdev=3283.77
  cpu          : usr=3.66%, sys=0.26%, ctx=1860
  IO depths    : 1=0.1%, 2=0.2%, 4=10.6%, 8=89.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.0%, 4=0.5%, 10=4.6%, 20=12.1%, 50=19.1%, 100=25.5%
     lat (msec): 250=31.6%, 500=4.7%, 750=0.5%, 1000=0.2%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,383KiB/s, minb=3,794KiB/s, maxb=4,484KiB/s, mint=23381msec, maxt=27635msec
  WRITE: io=108MiB, aggrb=4,777KiB/s, minb=1,346KiB/s, maxb=2,271KiB/s, mint=23381msec, maxt=27635msec

Disk stats (read/write):
  sda: ios=5042/1834, merge=1211/413, ticks=446060/285980, in_queue=732032, util=99.39%
3.04user 0.21system 0:27.94elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2411minor)pagefaults 0swaps