fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [12.0% done] [ 18889/   951 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [16.0% done] [ 10652/  9264 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [20.0% done] [ 12604/  5128 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [24.0% done] [  8288/  8668 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [26.9% done] [ 10756/  6324 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [30.8% done] [  2851/ 11151 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [33.3% done] [ 12432/  2652 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [37.0% done] [  9044/  5836 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [40.7% done] [ 11148/  4600 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [42.9% done] [  5168/  7440 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [46.4% done] [ 11548/  2200 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [50.0% done] [ 10484/  2620 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [51.7% done] [  8492/  3124 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [55.2% done] [ 12580/   168 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [56.7% done] [  8236/  2716 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [60.0% done] [  9252/  1284 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [61.3% done] [  6152/  3136 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [64.5% done] [  5524/  3632 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [65.6% done] [  5764/  2864 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [68.8% done] [  3028/  5192 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.9% done] [ 22068/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [75.0% done] [ 19168/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [78.1% done] [ 19548/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [83.9% done] [ 19008/     0 kb/s] [eta 00m:05s]
Threads: 2: [V_V] [87.1% done] [ 17496/     0 kb/s] [eta 00m:04s]
fio: (groupid=0): err= 0: pid=2188
  read : io=100MiB, bw=3,759KiB/s, runt= 27889msec
    slat (msec): min=    0, max= 6177, avg=1319.91, stdev=2109.58
    clat (msec): min=    1, max=  885, avg=97.10, stdev=91.08
    bw (KiB/s) : min=   22, max= 9786, per=36.47%, avg=4071.39, stdev=2456.04
  write: io=32,636KiB, bw=1,520KiB/s, runt= 21977msec
    slat (msec): min=    0, max=    6, avg= 0.11, stdev= 0.59
    clat (msec): min=    0, max=  840, avg=94.76, stdev=137.48
    bw (KiB/s) : min=    0, max= 9700, per=52.49%, avg=2689.67, stdev=2938.78
  cpu          : usr=3.37%, sys=0.20%, ctx=1888
  IO depths    : 1=0.1%, 2=0.2%, 4=12.2%, 8=87.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.9%, 4=0.8%, 10=4.4%, 20=11.7%, 50=22.1%, 100=24.0%
     lat (msec): 250=27.4%, 500=6.5%, 750=0.6%, 1000=0.4%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2189
  read : io=100MiB, bw=3,924KiB/s, runt= 26716msec
    slat (msec): min=    0, max= 5824, avg=896.37, stdev=1655.23
    clat (msec): min=    0, max=  368, avg=89.22, stdev=69.65
    bw (KiB/s) : min=   58, max=12304, per=38.84%, avg=4335.80, stdev=2863.25
  write: io=34,256KiB, bw=1,597KiB/s, runt= 21955msec
    slat (msec): min=    0, max=    9, avg= 0.16, stdev= 0.73
    clat (msec): min=    0, max= 1066, avg=126.40, stdev=160.91
    bw (KiB/s) : min=    0, max= 7249, per=59.52%, avg=3049.90, stdev=2276.49
  cpu          : usr=3.59%, sys=0.19%, ctx=1817
  IO depths    : 1=0.1%, 2=0.5%, 4=11.2%, 8=88.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.1%, 4=1.0%, 10=2.5%, 20=7.7%, 50=22.0%, 100=30.1%
     lat (msec): 250=29.7%, 500=4.9%, 750=0.3%, 1000=0.4%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2190
  read : io=100MiB, bw=3,721KiB/s, runt= 28179msec
    slat (msec): min=    0, max= 6238, avg=1736.04, stdev=2238.19
    clat (msec): min=    0, max=  645, avg=86.01, stdev=80.24
    bw (KiB/s) : min=   13, max=14204, per=39.48%, avg=4406.71, stdev=3148.15
  write: io=43,520KiB, bw=2,019KiB/s, runt= 22063msec
    slat (msec): min=    0, max=   10, avg= 0.12, stdev= 0.72
    clat (msec): min=    0, max=  770, avg=110.49, stdev=114.19
    bw (KiB/s) : min=    0, max= 8545, per=49.91%, avg=2557.13, stdev=2132.39
  cpu          : usr=3.41%, sys=0.20%, ctx=1849
  IO depths    : 1=0.2%, 2=0.3%, 4=15.5%, 8=84.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.8%, 4=0.8%, 10=4.7%, 20=12.1%, 50=22.5%, 100=25.3%
     lat (msec): 250=26.6%, 500=6.3%, 750=0.6%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,163KiB/s, minb=3,721KiB/s, maxb=3,924KiB/s, mint=26716msec, maxt=28179msec
  WRITE: io=108MiB, aggrb=5,124KiB/s, minb=1,520KiB/s, maxb=2,019KiB/s, mint=26716msec, maxt=28179msec

Disk stats (read/write):
  sda: ios=5051/1929, merge=1381/317, ticks=468848/241140, in_queue=709988, util=99.51%
2.91user 0.20system 0:28.37elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2392minor)pagefaults 0swaps