fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [13.0% done] [ 13660/ 12792 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [18.2% done] [ 10332/ 11680 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [23.8% done] [ 13684/ 10064 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [30.0% done] [ 18640/  3148 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [35.0% done] [ 11928/  7972 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [40.0% done] [ 10056/  9208 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [45.0% done] [ 13200/  6120 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [47.6% done] [  9600/  7488 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [52.4% done] [  9164/  5941 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [54.5% done] [  7516/  8140 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [56.5% done] [  7448/  5628 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [60.9% done] [  8768/  3248 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [62.5% done] [  4060/  6732 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [64.0% done] [  5484/  4900 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [68.0% done] [  3140/  6984 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 21584/   212 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 21716/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 18488/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.0% done] [ 21012/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [88.0% done] [ 19479/     0 kb/s] [eta 00m:03s]
Threads: 1: [__V] [92.0% done] [ 20704/     0 kb/s] [eta 00m:02s]
fio: (groupid=0): err= 0: pid=23762
  read : io=100MiB, bw=4,484KiB/s, runt= 23381msec
    slat (msec): min=    0, max= 6096, avg=1104.53, stdev=1773.45
    clat (msec): min=    0, max=  570, avg=82.71, stdev=79.69
    bw (KiB/s) : min=   55, max=10338, per=36.95%, avg=4937.82, stdev=2822.69
  write: io=32,588KiB, bw=1,926KiB/s, runt= 17320msec
    slat (msec): min=    0, max=    3, avg= 0.07, stdev= 0.33
    clat (msec): min=    0, max=  545, avg=71.66, stdev=77.36
    bw (KiB/s) : min=    0, max= 8255, per=43.70%, avg=3211.33, stdev=3001.47
  cpu          : usr=4.11%, sys=0.29%, ctx=1853
  IO depths    : 1=0.1%, 2=0.3%, 4=14.1%, 8=85.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.7%, 4=0.7%, 10=4.7%, 20=13.9%, 50=24.0%, 100=28.0%
     lat (msec): 250=22.3%, 500=4.3%, 750=0.4%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=23763
  read : io=100MiB, bw=4,496KiB/s, runt= 23320msec
    slat (msec): min=    0, max= 6834, avg=2513.81, stdev=2628.04
    clat (msec): min=    0, max=  398, avg=63.94, stdev=69.57
    bw (KiB/s) : min=   19, max=11475, per=39.47%, avg=5274.68, stdev=3345.95
  write: io=55,508KiB, bw=3,366KiB/s, runt= 16885msec
    slat (msec): min=    0, max=    2, avg= 0.04, stdev= 0.24
    clat (msec): min=    0, max=  810, avg=80.02, stdev=100.12
    bw (KiB/s) : min=    0, max=12477, per=56.37%, avg=4142.92, stdev=3245.75
  cpu          : usr=4.25%, sys=0.21%, ctx=1814
  IO depths    : 1=0.1%, 2=0.4%, 4=21.7%, 8=77.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=3.6%, 4=1.2%, 10=8.5%, 20=17.7%, 50=22.7%, 100=25.3%
     lat (msec): 250=16.5%, 500=4.2%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=23764
  read : io=100MiB, bw=4,454KiB/s, runt= 23540msec
    slat (msec): min=    0, max= 6798, avg=1462.19, stdev=2080.79
    clat (msec): min=    0, max=  780, avg=75.14, stdev=85.62
    bw (KiB/s) : min=   70, max=10758, per=37.03%, avg=4948.06, stdev=2974.71
  write: io=36,212KiB, bw=2,194KiB/s, runt= 16897msec
    slat (msec): min=    0, max=    5, avg= 0.06, stdev= 0.34
    clat (msec): min=    0, max=  800, avg=76.91, stdev=94.32
    bw (KiB/s) : min=    0, max= 7498, per=39.23%, avg=2883.00, stdev=2561.81
  cpu          : usr=3.81%, sys=0.34%, ctx=1881
  IO depths    : 1=0.2%, 2=0.5%, 4=15.2%, 8=84.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.1%, 4=1.0%, 10=5.0%, 20=15.7%, 50=28.1%, 100=26.3%
     lat (msec): 250=17.6%, 500=4.4%, 750=0.5%, 1000=0.2%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,363KiB/s, minb=4,454KiB/s, maxb=4,496KiB/s, mint=23320msec, maxt=23540msec
  WRITE: io=121MiB, aggrb=7,349KiB/s, minb=1,926KiB/s, maxb=3,366KiB/s, mint=23320msec, maxt=23540msec

Disk stats (read/write):
  sda: ios=4430/2266, merge=1731/427, ticks=334784/185576, in_queue=520356, util=99.27%
2.88user 0.20system 0:23.80elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2402minor)pagefaults 0swaps