fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [5.9% done] [  1141/     0 kb/s] [eta 00m:48s]
Threads: 3: [mmm] [6.7% done] [   833/   142 kb/s] [eta 00m:56s]
Threads: 3: [mmm] [8.3% done] [  1036/     0 kb/s] [eta 00m:55s]
Threads: 3: [mmm] [10.0% done] [   784/   365 kb/s] [eta 00m:54s]
Threads: 3: [mmF] [11.7% done] [  1446/ 79104 kb/s] [eta 00m:53s]
Threads: 3: [mmF] [13.3% done] [   166/     0 kb/s] [eta 00m:52s]
Threads: 3: [mmF] [15.0% done] [   621/   109 kb/s] [eta 00m:51s]
Threads: 3: [mmF] [16.7% done] [   349/     0 kb/s] [eta 00m:50s]
Threads: 3: [mmF] [18.3% done] [   138/     0 kb/s] [eta 00m:49s]
Threads: 3: [FmV] [20.0% done] [  4030/  1049 kb/s] [eta 00m:48s]
Threads: 3: [VmV] [21.7% done] [ 24836/     0 kb/s] [eta 00m:47s]
Threads: 3: [VmV] [23.3% done] [ 30305/     0 kb/s] [eta 00m:46s]
Threads: 3: [VmV] [25.0% done] [ 36362/   514 kb/s] [eta 00m:45s]
Threads: 3: [VmV] [26.7% done] [ 37292/     0 kb/s] [eta 00m:44s]
Threads: 3: [VmV] [28.3% done] [ 31956/     0 kb/s] [eta 00m:43s]
Threads: 3: [VmV] [30.0% done] [ 31520/   188 kb/s] [eta 00m:42s]
Threads: 1: [_m_] [31.7% done] [ 15768/     0 kb/s] [eta 00m:41s]
Threads: 1: [_m_] [57.1% done] [  5692/ 55616 kb/s] [eta 00m:15s]
Threads: 1: [_F_] [100.0% done] [  1576/ 13088 kb/s] [eta 00m:00s]
Threads: 1: [_F_] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [_F_] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [_V_] [82.8% done] [ 22776/     0 kb/s] [eta 00m:05s]
Threads: 1: [_V_] [100.0% done] [ 27068/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=2365
  read : io=100MiB, bw=5,670KiB/s, runt= 18493msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 3243, avg=75.36, stdev=250.90
    bw (KiB/s) : min=    5, max=21856, per=54.09%, avg=6453.38, stdev=7747.10
  write: io=97,540KiB, bw=8,208KiB/s, runt= 12168msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1604, avg= 9.04, stdev=91.75
    bw (KiB/s) : min=    0, max=68624, per=128.93%, avg=15002.83, stdev=27032.80
  cpu          : usr=5.32%, sys=2.18%, ctx=6561
  IO depths    : 1=6.2%, 2=43.5%, 4=33.3%, 8=17.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=42.8%, 4=1.9%, 10=17.2%, 20=17.2%, 50=7.7%, 100=3.2%
     lat (msec): 250=7.1%, 500=0.7%, 750=0.7%, 1000=0.5%, >=2000=0.8%
fio: (groupid=0): err= 0: pid=2366
  read : io=100MiB, bw=3,976KiB/s, runt= 26365msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 4821, avg=97.80, stdev=426.68
    bw (KiB/s) : min=   11, max=28802, per=44.86%, avg=5352.47, stdev=8991.18
  write: io=70,580KiB, bw=3,085KiB/s, runt= 23424msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 2655, avg=15.69, stdev=171.35
    bw (KiB/s) : min=    0, max=57191, per=82.82%, avg=9636.50, stdev=23297.12
  cpu          : usr=2.17%, sys=1.46%, ctx=7733
  IO depths    : 1=1.4%, 2=48.5%, 4=30.2%, 8=19.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=43.9%, 4=0.0%, 10=14.9%, 20=16.9%, 50=15.1%, 100=4.9%
     lat (msec): 250=1.6%, 500=0.3%, 750=0.1%, 1000=0.2%, >=2000=1.0%
fio: (groupid=0): err= 0: pid=2367
  read : io=100MiB, bw=5,732KiB/s, runt= 18292msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 3054, avg=52.43, stdev=212.53
    bw (KiB/s) : min=   35, max=22755, per=74.07%, avg=8837.05, stdev=8327.36
  write: io=98,060KiB, bw=8,630KiB/s, runt= 11635msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 2886, avg= 8.09, stdev=122.29
    bw (KiB/s) : min=    0, max=20971, per=60.94%, avg=7091.25, stdev=9868.14
  cpu          : usr=4.79%, sys=2.38%, ctx=6208
  IO depths    : 1=3.5%, 2=47.8%, 4=34.9%, 8=13.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=43.8%, 4=1.0%, 10=20.2%, 20=21.1%, 50=4.1%, 100=1.4%
     lat (msec): 250=7.3%, 500=0.3%, 750=0.0%, 1000=0.0%, >=2000=0.2%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,931KiB/s, minb=3,976KiB/s, maxb=5,732KiB/s, mint=18292msec, maxt=26365msec
  WRITE: io=260MiB, aggrb=11,636KiB/s, minb=3,085KiB/s, maxb=8,630KiB/s, mint=18292msec, maxt=26365msec

Disk stats (read/write):
  sda: ios=3815/2714, merge=1098/63650, ticks=78948/1584288, in_queue=1666856, util=96.27%
2.47user 1.27system 0:26.79elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2477minor)pagefaults 0swaps