fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.1% done] [ 13196/  5596 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [15.4% done] [ 17292/  1612 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [19.2% done] [ 14120/  4168 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [24.0% done] [  6764/  8668 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [26.9% done] [ 16952/   172 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [29.6% done] [ 16412/  1032 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [33.3% done] [  8820/  5908 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [37.0% done] [ 13980/  1036 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [40.7% done] [ 11236/  3836 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [44.4% done] [ 10276/  3768 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [46.4% done] [ 10420/  4216 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [48.3% done] [  8384/  3924 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [51.7% done] [  5528/  6248 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [53.3% done] [  8612/  2724 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [56.7% done] [  8936/  2384 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [58.1% done] [  5936/  5140 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [59.4% done] [  4004/  5760 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [62.5% done] [  6448/  3360 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [65.6% done] [  8708/   640 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [71.0% done] [ 15752/  1156 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [74.2% done] [ 17832/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [75.0% done] [ 17628/     0 kb/s] [eta 00m:08s]
Threads: 2: [V_V] [78.1% done] [ 17964/     0 kb/s] [eta 00m:07s]
fio: (groupid=0): err= 0: pid=3023
  read : io=100MiB, bw=4,067KiB/s, runt= 25780msec
    slat (msec): min=    0, max= 4221, avg=605.23, stdev=1217.42
    clat (msec): min=    1, max=  499, avg=95.97, stdev=85.76
    bw (KiB/s) : min=  296, max= 9372, per=35.69%, avg=4251.95, stdev=2199.09
  write: io=22,648KiB, bw=1,074KiB/s, runt= 21588msec
    slat (msec): min=    0, max=    5, avg= 0.05, stdev= 0.31
    clat (msec): min=    0, max=  725, avg=116.46, stdev=127.85
    bw (KiB/s) : min=    0, max= 7077, per=48.09%, avg=1864.30, stdev=1856.59
  cpu          : usr=3.52%, sys=0.26%, ctx=1746
  IO depths    : 1=0.1%, 2=0.2%, 4=10.0%, 8=89.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.6%, 4=0.2%, 10=3.7%, 20=14.0%, 50=21.9%, 100=19.7%
     lat (msec): 250=32.9%, 500=6.3%, 750=0.5%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=3024
  read : io=100MiB, bw=4,211KiB/s, runt= 24900msec
    slat (msec): min=    0, max= 4954, avg=945.59, stdev=1586.81
    clat (msec): min=    5, max=  442, avg=82.28, stdev=67.62
    bw (KiB/s) : min=   38, max=11996, per=38.70%, avg=4611.63, stdev=3063.79
  write: io=29,888KiB, bw=1,532KiB/s, runt= 19968msec
    slat (msec): min=    0, max=   15, avg= 0.20, stdev= 1.22
    clat (msec): min=    0, max=  741, avg=116.75, stdev=106.89
    bw (KiB/s) : min=    0, max= 8589, per=60.54%, avg=2347.17, stdev=2357.78
  cpu          : usr=3.50%, sys=0.19%, ctx=1717
  IO depths    : 1=0.1%, 2=0.2%, 4=12.1%, 8=87.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.5%, 4=0.3%, 10=2.1%, 20=9.7%, 50=24.9%, 100=29.0%
     lat (msec): 250=28.7%, 500=4.3%, 750=0.3%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=3025
  read : io=100MiB, bw=3,971KiB/s, runt= 26401msec
    slat (msec): min=    0, max= 5491, avg=1360.59, stdev=2024.70
    clat (msec): min=    1, max=  615, avg=91.06, stdev=85.50
    bw (KiB/s) : min=    7, max=16522, per=35.44%, avg=4222.26, stdev=3096.80
  write: io=29,216KiB, bw=1,425KiB/s, runt= 20992msec
    slat (msec): min=    0, max=    4, avg= 0.08, stdev= 0.39
    clat (msec): min=    0, max=  979, avg=96.91, stdev=107.62
    bw (KiB/s) : min=    0, max= 5505, per=54.26%, avg=2103.82, stdev=1950.94
  cpu          : usr=2.97%, sys=0.18%, ctx=1826
  IO depths    : 1=0.1%, 2=0.2%, 4=11.3%, 8=88.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.4%, 4=0.3%, 10=3.7%, 20=11.3%, 50=22.6%, 100=27.7%
     lat (msec): 250=28.5%, 500=4.8%, 750=0.4%, 1000=0.2%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,915KiB/s, minb=3,971KiB/s, maxb=4,211KiB/s, mint=24900msec, maxt=26401msec
  WRITE: io=81,752KiB, aggrb=3,877KiB/s, minb=1,074KiB/s, maxb=1,532KiB/s, mint=24900msec, maxt=26401msec

Disk stats (read/write):
  sda: ios=5032/1509, merge=1426/335, ticks=476032/229112, in_queue=705144, util=99.52%
2.63user 0.26system 0:26.63elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2380minor)pagefaults 0swaps