fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [14.3% done] [  8692/ 15700 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [20.0% done] [ 15732/  8156 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [25.0% done] [  5924/ 15072 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [30.0% done] [  7872/ 14724 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [35.0% done] [ 13672/  6800 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [40.0% done] [ 10348/ 10088 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [42.9% done] [ 11236/  7280 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [47.6% done] [  8008/  8716 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [50.0% done] [  7508/  7928 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [54.5% done] [ 10908/  4080 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [56.5% done] [ 10120/  4316 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [60.9% done] [  9928/  2544 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [62.5% done] [  9516/  3272 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [64.0% done] [  6192/  3712 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [68.0% done] [ 12916/   112 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [75.0% done] [ 24180/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [79.2% done] [ 22392/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [83.3% done] [ 21348/     0 kb/s] [eta 00m:04s]
Threads: 2: [VV_] [91.3% done] [ 25184/     0 kb/s] [eta 00m:02s]
Threads: 2: [VV_] [100.0% done] [ 24268/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=28791
  read : io=100MiB, bw=4,608KiB/s, runt= 22751msec
    slat (msec): min=    0, max= 5760, avg=1678.64, stdev=2000.75
    clat (msec): min=    0, max=  501, avg=61.19, stdev=69.36
    bw (KiB/s) : min=    2, max=15089, per=41.88%, avg=5790.60, stdev=4491.71
  write: io=58,180KiB, bw=3,503KiB/s, runt= 17004msec
    slat (msec): min=    0, max=    3, avg= 0.06, stdev= 0.28
    clat (msec): min=    0, max=  809, avg=93.65, stdev=97.72
    bw (KiB/s) : min=    0, max= 8216, per=53.44%, avg=4207.69, stdev=2858.26
  cpu          : usr=4.92%, sys=0.35%, ctx=1741
  IO depths    : 1=0.2%, 2=0.6%, 4=21.9%, 8=77.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.5%, 4=1.0%, 10=5.4%, 20=17.6%, 50=27.7%, 100=23.2%
     lat (msec): 250=19.3%, 500=3.8%, 750=0.4%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=28792
  read : io=100MiB, bw=4,664KiB/s, runt= 22479msec
    slat (msec): min=    0, max= 6063, avg=1505.60, stdev=2060.72
    clat (msec): min=    0, max=  637, avg=68.66, stdev=62.69
    bw (KiB/s) : min=  127, max=14588, per=43.04%, avg=5950.26, stdev=4096.17
  write: io=50,660KiB, bw=3,151KiB/s, runt= 16459msec
    slat (msec): min=    0, max=    6, avg= 0.09, stdev= 0.46
    clat (msec): min=    0, max=  908, avg=90.06, stdev=107.94
    bw (KiB/s) : min=    0, max=10675, per=59.26%, avg=4666.00, stdev=3797.83
  cpu          : usr=4.50%, sys=0.34%, ctx=1837
  IO depths    : 1=0.1%, 2=0.4%, 4=15.0%, 8=84.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.9%, 4=0.7%, 10=4.1%, 20=12.0%, 50=28.6%, 100=28.4%
     lat (msec): 250=21.3%, 500=2.4%, 750=0.4%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=28793
  read : io=100MiB, bw=5,093KiB/s, runt= 20585msec
    slat (msec): min=    0, max= 4048, avg=451.91, stdev=1008.96
    clat (msec): min=    3, max=  568, avg=77.92, stdev=68.30
    bw (KiB/s) : min=    8, max=12010, per=39.12%, avg=5409.28, stdev=2968.49
  write: io=21,912KiB, bw=1,360KiB/s, runt= 16494msec
    slat (msec): min=    0, max=    2, avg= 0.06, stdev= 0.29
    clat (msec): min=    0, max=  600, avg=86.72, stdev=85.02
    bw (KiB/s) : min=    0, max= 7893, per=37.48%, avg=2951.23, stdev=2947.61
  cpu          : usr=4.53%, sys=0.27%, ctx=1772
  IO depths    : 1=0.2%, 2=0.2%, 4=8.2%, 8=91.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.7%, 4=0.2%, 10=2.2%, 20=10.3%, 50=27.7%, 100=33.6%
     lat (msec): 250=21.5%, 500=3.5%, 750=0.2%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,826KiB/s, minb=4,608KiB/s, maxb=5,093KiB/s, mint=20585msec, maxt=22751msec
  WRITE: io=128MiB, aggrb=7,874KiB/s, minb=1,360KiB/s, maxb=3,503KiB/s, mint=20585msec, maxt=22751msec

Disk stats (read/write):
  sda: ios=4369/1901, merge=1723/597, ticks=302028/208924, in_queue=510960, util=99.28%
3.12user 0.24system 0:23.03elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2392minor)pagefaults 0swaps