fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [9.1% done] [ 14072/  5672 kb/s] [eta 00m:30s]
Threads: 3: [mmm] [14.3% done] [ 13404/  5284 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [17.9% done] [ 15160/  2268 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [21.4% done] [  8720/  8288 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [25.0% done] [ 10580/  6012 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [27.6% done] [ 13236/   532 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [31.0% done] [ 13512/  2308 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [34.5% done] [ 11260/  5356 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [36.7% done] [ 11260/  3836 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [40.0% done] [  8400/  5480 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [43.3% done] [  7860/  5640 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [46.7% done] [ 10176/  3020 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [48.4% done] [  7620/  3540 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [51.6% done] [  8728/  2912 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [54.8% done] [  6104/  4012 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [56.2% done] [  1976/  8704 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [57.6% done] [  4240/  5440 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [60.6% done] [  4416/  4252 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [65.6% done] [  6228/  3768 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [68.8% done] [  9100/  3516 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.9% done] [ 18688/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [75.0% done] [ 16192/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [80.6% done] [ 17988/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [83.9% done] [ 17660/     0 kb/s] [eta 00m:05s]
Threads: 2: [_VV] [90.0% done] [ 17336/     0 kb/s] [eta 00m:03s]
fio: (groupid=0): err= 0: pid=21390
  read : io=100MiB, bw=3,825KiB/s, runt= 27407msec
    slat (msec): min=    0, max= 5730, avg=1167.71, stdev=1746.63
    clat (msec): min=    1, max=  513, avg=92.01, stdev=90.94
    bw (KiB/s) : min=   22, max= 9880, per=37.96%, avg=4240.98, stdev=2236.63
  write: io=27,884KiB, bw=1,304KiB/s, runt= 21893msec
    slat (msec): min=    0, max=    2, avg= 0.03, stdev= 0.18
    clat (msec): min=    0, max=  923, avg=88.82, stdev=126.12
    bw (KiB/s) : min=    0, max= 6902, per=46.84%, avg=2333.27, stdev=2067.47
  cpu          : usr=3.36%, sys=0.18%, ctx=1849
  IO depths    : 1=0.1%, 2=0.3%, 4=15.5%, 8=84.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.3%, 4=0.8%, 10=6.3%, 20=18.1%, 50=23.6%, 100=15.3%
     lat (msec): 250=26.3%, 500=7.4%, 750=0.6%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=21391
  read : io=100MiB, bw=3,776KiB/s, runt= 27763msec
    slat (msec): min=    0, max= 8136, avg=1874.45, stdev=2733.69
    clat (msec): min=    0, max=  570, avg=90.86, stdev=83.68
    bw (KiB/s) : min=   98, max= 9040, per=39.30%, avg=4390.45, stdev=2315.73
  write: io=37,988KiB, bw=1,976KiB/s, runt= 19677msec
    slat (msec): min=    0, max=    5, avg= 0.06, stdev= 0.35
    clat (msec): min=    0, max=  816, avg=104.09, stdev=113.53
    bw (KiB/s) : min=    0, max= 8249, per=56.55%, avg=2816.52, stdev=2444.95
  cpu          : usr=3.40%, sys=0.17%, ctx=1720
  IO depths    : 1=0.2%, 2=0.3%, 4=14.5%, 8=85.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.7%, 4=0.7%, 10=4.0%, 20=10.8%, 50=24.5%, 100=24.5%
     lat (msec): 250=27.4%, 500=6.7%, 750=0.5%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=21392
  read : io=100MiB, bw=3,724KiB/s, runt= 28154msec
    slat (msec): min=    0, max= 7310, avg=1927.56, stdev=2551.82
    clat (msec): min=    0, max=  568, avg=83.98, stdev=81.08
    bw (KiB/s) : min=   53, max=13211, per=41.67%, avg=4655.31, stdev=2881.33
  write: io=40,628KiB, bw=1,966KiB/s, runt= 21159msec
    slat (msec): min=    0, max=    4, avg= 0.05, stdev= 0.28
    clat (msec): min=    0, max=  718, avg=109.24, stdev=109.18
    bw (KiB/s) : min=    0, max= 8102, per=56.78%, avg=2828.31, stdev=2224.10
  cpu          : usr=3.11%, sys=0.21%, ctx=1868
  IO depths    : 1=0.1%, 2=0.3%, 4=15.5%, 8=84.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.0%, 4=1.0%, 10=4.5%, 20=12.4%, 50=25.1%, 100=21.9%
     lat (msec): 250=27.3%, 500=6.4%, 750=0.5%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,173KiB/s, minb=3,724KiB/s, maxb=3,825KiB/s, mint=27407msec, maxt=28154msec
  WRITE: io=104MiB, aggrb=4,981KiB/s, minb=1,304KiB/s, maxb=1,976KiB/s, mint=27407msec, maxt=28154msec

Disk stats (read/write):
  sda: ios=4932/2011, merge=1574/406, ticks=471944/224276, in_queue=696220, util=99.50%
2.78user 0.16system 0:28.54elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2412minor)pagefaults 0swaps