fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.5% done] [ 13580/  6188 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [15.4% done] [ 11096/  7016 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [19.2% done] [ 11764/  6552 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [22.2% done] [ 11296/  4412 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [25.0% done] [ 13308/  3464 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [28.6% done] [ 15668/   312 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [33.3% done] [ 15072/     0 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [37.0% done] [ 15500/     0 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [40.7% done] [  7192/  7820 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [44.4% done] [ 13384/    76 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [46.4% done] [ 11448/  1932 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [50.0% done] [  9308/  3732 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [51.7% done] [  7136/  4796 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [55.2% done] [  6356/  5384 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [58.6% done] [  8092/  3416 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [60.0% done] [  8016/  3072 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [63.3% done] [  6844/  3560 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [64.5% done] [  6886/  2998 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [65.6% done] [  6148/  2580 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [68.8% done] [ 15068/   324 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [74.2% done] [ 16856/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [77.4% done] [ 19004/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [80.6% done] [ 17460/     0 kb/s] [eta 00m:06s]
fio: (groupid=0): err= 0: pid=13576
  read : io=100MiB, bw=4,034KiB/s, runt= 25991msec
    slat (msec): min=    0, max= 4385, avg=570.75, stdev=1135.09
    clat (msec): min=    2, max=  629, avg=98.54, stdev=86.36
    bw (KiB/s) : min=   74, max=10421, per=35.77%, avg=4264.48, stdev=2517.52
  write: io=26,000KiB, bw=1,231KiB/s, runt= 21612msec
    slat (msec): min=    0, max=    5, avg= 0.13, stdev= 0.53
    clat (msec): min=    0, max=  919, avg=120.63, stdev=143.96
    bw (KiB/s) : min=    0, max= 6571, per=48.90%, avg=1862.05, stdev=1905.72
  cpu          : usr=3.54%, sys=0.32%, ctx=1707
  IO depths    : 1=0.2%, 2=0.2%, 4=10.5%, 8=89.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.8%, 4=0.3%, 10=3.5%, 20=10.3%, 50=20.8%, 100=24.9%
     lat (msec): 250=31.1%, 500=7.1%, 750=1.0%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13577
  read : io=100MiB, bw=4,055KiB/s, runt= 25854msec
    slat (msec): min=    0, max= 5378, avg=620.58, stdev=1383.04
    clat (msec): min=    4, max=  553, avg=90.38, stdev=73.55
    bw (KiB/s) : min=   15, max=10401, per=34.35%, avg=4094.73, stdev=2234.43
  write: io=25,724KiB, bw=1,285KiB/s, runt= 20484msec
    slat (msec): min=    0, max=    7, avg= 0.17, stdev= 0.69
    clat (msec): min=    0, max=  839, avg=123.12, stdev=148.98
    bw (KiB/s) : min=    0, max= 8599, per=61.11%, avg=2327.00, stdev=2549.70
  cpu          : usr=3.70%, sys=0.19%, ctx=1814
  IO depths    : 1=0.1%, 2=0.2%, 4=8.5%, 8=91.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.5%, 4=0.4%, 10=2.2%, 20=9.7%, 50=20.9%, 100=30.0%
     lat (msec): 250=29.7%, 500=4.8%, 750=0.4%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13578
  read : io=100MiB, bw=3,973KiB/s, runt= 26386msec
    slat (msec): min=    0, max= 5344, avg=1064.91, stdev=1721.35
    clat (msec): min=    1, max=  818, avg=90.24, stdev=84.35
    bw (KiB/s) : min=   28, max= 9109, per=34.10%, avg=4064.84, stdev=2284.08
  write: io=28,748KiB, bw=1,360KiB/s, runt= 21635msec
    slat (msec): min=    0, max=    2, avg= 0.03, stdev= 0.17
    clat (msec): min=    0, max=  961, avg=97.50, stdev=107.42
    bw (KiB/s) : min=    0, max= 5767, per=55.71%, avg=2121.46, stdev=1846.16
  cpu          : usr=3.26%, sys=0.20%, ctx=1887
  IO depths    : 1=0.1%, 2=0.2%, 4=11.1%, 8=88.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.8%, 4=0.8%, 10=4.1%, 20=12.3%, 50=23.8%, 100=23.7%
     lat (msec): 250=27.5%, 500=6.6%, 750=0.2%, 1000=0.2%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,921KiB/s, minb=3,973KiB/s, maxb=4,055KiB/s, mint=25854msec, maxt=26386msec
  WRITE: io=80,472KiB, aggrb=3,808KiB/s, minb=1,231KiB/s, maxb=1,360KiB/s, mint=25854msec, maxt=26386msec

Disk stats (read/write):
  sda: ios=5161/1402, merge=1249/299, ticks=502928/202192, in_queue=705116, util=99.42%
2.78user 0.22system 0:26.71elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2379minor)pagefaults 0swaps