fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [15.8% done] [ 19712/  5428 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [21.1% done] [ 10200/ 13544 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [26.3% done] [ 18084/  2588 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [31.6% done] [ 17100/  4180 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [35.0% done] [ 17268/  3924 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [40.0% done] [ 11720/  9480 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [42.9% done] [  6588/ 12112 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [47.6% done] [  7308/  9820 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [50.0% done] [  6008/ 10064 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [54.5% done] [  8864/  5716 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [56.5% done] [  9820/  4404 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [60.9% done] [  4792/  7920 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [62.5% done] [  6820/  4724 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [64.0% done] [  9444/  1880 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [68.0% done] [  4844/  5748 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 22244/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 19960/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 20124/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.0% done] [ 19724/     0 kb/s] [eta 00m:04s]
Threads: 1: [V__] [91.7% done] [ 18696/     0 kb/s] [eta 00m:02s]
fio: (groupid=0): err= 0: pid=19514
  read : io=100MiB, bw=4,596KiB/s, runt= 22811msec
    slat (msec): min=    0, max= 5761, avg=1600.14, stdev=2071.32
    clat (msec): min=    0, max=  477, avg=73.38, stdev=75.43
    bw (KiB/s) : min=   20, max=11686, per=36.76%, avg=5069.03, stdev=3160.32
  write: io=43,808KiB, bw=2,630KiB/s, runt= 17056msec
    slat (msec): min=    0, max=    6, avg= 0.06, stdev= 0.35
    clat (msec): min=    0, max=  838, avg=76.96, stdev=92.10
    bw (KiB/s) : min=    0, max= 8902, per=52.45%, avg=3551.86, stdev=2887.35
  cpu          : usr=5.05%, sys=0.37%, ctx=1812
  IO depths    : 1=0.1%, 2=0.5%, 4=16.0%, 8=83.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=2.2%, 4=1.0%, 10=5.7%, 20=16.9%, 50=27.2%, 100=22.2%
     lat (msec): 250=19.8%, 500=4.7%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=19515
  read : io=100MiB, bw=4,696KiB/s, runt= 22325msec
    slat (msec): min=    0, max= 5830, avg=1227.95, stdev=1860.20
    clat (msec): min=    2, max=  375, avg=76.72, stdev=70.46
    bw (KiB/s) : min=   85, max=11381, per=36.65%, avg=5054.66, stdev=3050.03
  write: io=38,160KiB, bw=2,358KiB/s, runt= 16568msec
    slat (msec): min=    0, max=    3, avg= 0.05, stdev= 0.28
    clat (msec): min=    0, max=  657, avg=81.42, stdev=90.12
    bw (KiB/s) : min=    0, max= 8954, per=52.42%, avg=3549.84, stdev=2953.93
  cpu          : usr=4.14%, sys=0.27%, ctx=1792
  IO depths    : 1=0.1%, 2=0.3%, 4=13.5%, 8=86.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.4%, 4=0.9%, 10=3.9%, 20=12.3%, 50=29.0%, 100=26.0%
     lat (msec): 250=22.5%, 500=3.6%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=19516
  read : io=100MiB, bw=4,742KiB/s, runt= 22111msec
    slat (msec): min=    0, max= 6254, avg=1345.96, stdev=2026.67
    clat (msec): min=    3, max=  425, avg=76.68, stdev=73.33
    bw (KiB/s) : min=   35, max=11190, per=39.27%, avg=5415.06, stdev=3013.38
  write: io=30,836KiB, bw=1,978KiB/s, runt= 15960msec
    slat (msec): min=    0, max=    2, avg= 0.05, stdev= 0.24
    clat (msec): min=    0, max=  754, avg=77.36, stdev=85.18
    bw (KiB/s) : min=    0, max= 9136, per=54.10%, avg=3663.80, stdev=2708.86
  cpu          : usr=4.23%, sys=0.38%, ctx=1752
  IO depths    : 1=0.1%, 2=0.2%, 4=13.7%, 8=86.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.4%, 4=0.7%, 10=4.8%, 20=14.0%, 50=26.9%, 100=29.0%
     lat (msec): 250=19.4%, 500=4.6%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,790KiB/s, minb=4,596KiB/s, maxb=4,742KiB/s, mint=22111msec, maxt=22811msec
  WRITE: io=110MiB, aggrb=6,772KiB/s, minb=1,978KiB/s, maxb=2,630KiB/s, mint=22111msec, maxt=22811msec

Disk stats (read/write):
  sda: ios=4426/1924, merge=1545/528, ticks=353128/179128, in_queue=532260, util=99.20%
3.10user 0.29system 0:23.09elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2401minor)pagefaults 0swaps