fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [42.9% done] [   696/175560 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [40.0% done] [   984/    32 kb/s] [eta 00m:06s]
Threads: 3: [FFm] [45.5% done] [  1401/  5365 kb/s] [eta 00m:06s]
Threads: 3: [FFm] [46.2% done] [  1016/     0 kb/s] [eta 00m:07s]
Threads: 3: [FFm] [50.0% done] [  1125/  3883 kb/s] [eta 00m:07s]
Threads: 3: [FFF] [100.0% done] [     0/ 29872 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVF] [68.4% done] [  1216/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVF] [73.7% done] [ 28812/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVF] [83.3% done] [ 22308/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVF] [94.1% done] [ 34764/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVF] [100.0% done] [ 23644/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVF] [100.0% done] [ 32868/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVF] [100.0% done] [ 29192/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VF] [100.0% done] [ 17141/     0 kb/s] [eta 00m:00s]
Threads: 1: [__F] [100.0% done] [  2248/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [81.5% done] [ 19310/     0 kb/s] [eta 00m:05s]
Threads: 1: [__V] [100.0% done] [ 30999/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [100.0% done] [ 33504/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=17075
  read : io=100MiB, bw=5,223KiB/s, runt= 20065msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  566, avg=40.73, stdev=77.63
    bw (KiB/s) : min=    0, max=27469, per=90.93%, avg=11498.00, stdev=8535.31
  write: io=95,816KiB, bw=7,394KiB/s, runt= 13268msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  230, avg= 0.73, stdev= 6.54
    bw (KiB/s) : min=    0, max=116015, per=466.00%, avg=62248.00, stdev=58470.64
  cpu          : usr=5.18%, sys=1.83%, ctx=4729
  IO depths    : 1=1.6%, 2=56.4%, 4=30.2%, 8=11.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=45.1%, 4=4.2%, 10=21.1%, 20=13.0%, 50=7.3%, 100=2.0%
     lat (msec): 250=5.6%, 500=1.2%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17076
  read : io=100MiB, bw=5,068KiB/s, runt= 20681msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  415, avg=42.64, stdev=70.71
    bw (KiB/s) : min=    2, max=28835, per=83.63%, avg=10575.41, stdev=8324.89
  write: io=96,556KiB, bw=7,636KiB/s, runt= 12948msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  278, avg= 0.81, stdev= 8.59
    bw (KiB/s) : min=    0, max=112893, per=422.57%, avg=56446.50, stdev=79827.41
  cpu          : usr=4.08%, sys=2.17%, ctx=4870
  IO depths    : 1=1.8%, 2=54.3%, 4=31.8%, 8=12.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.9%, 4=0.7%, 10=18.3%, 20=14.0%, 50=6.8%, 100=3.8%
     lat (msec): 250=5.6%, 500=1.6%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17077
  read : io=100MiB, bw=4,216KiB/s, runt= 24871msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1055, avg=42.31, stdev=116.26
    bw (KiB/s) : min=    4, max=39043, per=82.65%, avg=10451.63, stdev=14038.60
  write: io=89,668KiB, bw=4,246KiB/s, runt= 21620msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  455, avg= 3.02, stdev=24.90
    bw (KiB/s) : min=    0, max=79593, per=164.54%, avg=21979.75, stdev=38506.73
  cpu          : usr=3.75%, sys=1.96%, ctx=5328
  IO depths    : 1=3.3%, 2=56.9%, 4=28.5%, 8=11.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=44.3%, 4=4.5%, 10=16.8%, 20=20.7%, 50=7.6%, 100=0.7%
     lat (msec): 250=2.7%, 500=1.6%, 750=0.7%, 1000=0.3%, >=2000=0.1%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,645KiB/s, minb=4,216KiB/s, maxb=5,223KiB/s, mint=20065msec, maxt=24871msec
  WRITE: io=275MiB, aggrb=13,358KiB/s, minb=4,246KiB/s, maxb=7,636KiB/s, mint=20065msec, maxt=24871msec

Disk stats (read/write):
  sda: ios=3381/2150, merge=1213/68318, ticks=68676/2285200, in_queue=2354108, util=94.94%
2.86user 1.37system 0:25.26elapsed 16%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2473minor)pagefaults 0swaps