fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [12.5% done] [ 10348/ 13472 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [18.2% done] [ 15904/  9564 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [23.8% done] [  2668/ 19360 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [27.3% done] [ 14456/  7316 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [33.3% done] [  9108/ 11276 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [38.1% done] [ 11752/  8204 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [40.9% done] [ 12880/  4972 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [45.5% done] [  8132/ 10388 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [47.8% done] [ 14280/  1300 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [52.2% done] [  8796/  4980 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [56.5% done] [ 10376/  3176 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [58.3% done] [  9036/  4000 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [62.5% done] [ 13620/    56 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [64.0% done] [  5855/  4242 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [68.0% done] [ 10105/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 20666/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 21036/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 22625/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.0% done] [ 22105/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [88.0% done] [ 21999/     0 kb/s] [eta 00m:03s]
fio: (groupid=0): err= 0: pid=26412
  read : io=100MiB, bw=4,645KiB/s, runt= 22571msec
    slat (msec): min=    0, max= 5140, avg=700.30, stdev=1377.76
    clat (msec): min=    0, max=  446, avg=75.69, stdev=69.39
    bw (KiB/s) : min=  164, max=10363, per=36.79%, avg=5087.97, stdev=2667.26
  write: io=41,892KiB, bw=2,467KiB/s, runt= 17386msec
    slat (msec): min=    0, max=    4, avg= 0.09, stdev= 0.41
    clat (msec): min=    0, max=  872, avg=113.04, stdev=131.90
    bw (KiB/s) : min=    0, max= 8939, per=64.27%, avg=4300.44, stdev=3049.38
  cpu          : usr=4.18%, sys=0.39%, ctx=1812
  IO depths    : 1=0.1%, 2=0.2%, 4=10.8%, 8=88.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.5%, 4=0.3%, 10=3.4%, 20=9.3%, 50=29.5%, 100=30.0%
     lat (msec): 250=21.6%, 500=4.8%, 750=0.2%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=26413
  read : io=100MiB, bw=4,609KiB/s, runt= 22748msec
    slat (msec): min=    0, max= 6902, avg=1666.36, stdev=2367.75
    clat (msec): min=    2, max=  448, avg=75.37, stdev=69.87
    bw (KiB/s) : min=   72, max=10643, per=37.20%, avg=5143.56, stdev=3115.25
  write: io=35,756KiB, bw=2,269KiB/s, runt= 16130msec
    slat (msec): min=    0, max=    3, avg= 0.04, stdev= 0.26
    clat (msec): min=    0, max=  872, avg=76.20, stdev=80.33
    bw (KiB/s) : min=    0, max= 7997, per=48.48%, avg=3243.95, stdev=3032.82
  cpu          : usr=4.29%, sys=0.30%, ctx=1823
  IO depths    : 1=0.1%, 2=0.2%, 4=12.5%, 8=87.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.8%, 4=0.8%, 10=4.6%, 20=12.4%, 50=29.7%, 100=26.4%
     lat (msec): 250=21.2%, 500=3.9%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=26414
  read : io=100MiB, bw=4,651KiB/s, runt= 22542msec
    slat (msec): min=    0, max= 5283, avg=810.77, stdev=1468.97
    clat (msec): min=    0, max=  494, avg=78.44, stdev=71.14
    bw (KiB/s) : min=   35, max=10579, per=34.65%, avg=4791.42, stdev=3052.12
  write: io=35,972KiB, bw=2,152KiB/s, runt= 17114msec
    slat (msec): min=    0, max=    2, avg= 0.04, stdev= 0.23
    clat (msec): min=    0, max=  842, avg=98.80, stdev=109.34
    bw (KiB/s) : min=    0, max=10691, per=50.76%, avg=3396.06, stdev=3550.07
  cpu          : usr=4.06%, sys=0.37%, ctx=1796
  IO depths    : 1=0.1%, 2=0.3%, 4=11.2%, 8=88.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.2%, 4=0.3%, 10=3.1%, 20=12.3%, 50=26.7%, 100=27.9%
     lat (msec): 250=23.4%, 500=4.6%, 750=0.4%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,828KiB/s, minb=4,609KiB/s, maxb=4,651KiB/s, mint=22542msec, maxt=22748msec
  WRITE: io=111MiB, aggrb=6,691KiB/s, minb=2,152KiB/s, maxb=2,467KiB/s, mint=22542msec, maxt=22748msec

Disk stats (read/write):
  sda: ios=4560/1592, merge=1343/471, ticks=346396/319620, in_queue=666016, util=99.47%
2.88user 0.36system 0:23.03elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2375minor)pagefaults 0swaps