fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [20.0% done] [  1848/     0 kb/s] [eta 00m:12s]
Threads: 3: [mFm] [21.1% done] [  1697/   604 kb/s] [eta 00m:15s]
Threads: 3: [FFm] [21.7% done] [  1728/ 17548 kb/s] [eta 00m:18s]
Threads: 3: [FFm] [23.1% done] [  1364/     0 kb/s] [eta 00m:20s]
Threads: 3: [FFm] [24.1% done] [  1828/   784 kb/s] [eta 00m:22s]
Threads: 3: [FFm] [25.0% done] [   984/     0 kb/s] [eta 00m:24s]
Threads: 3: [FFm] [25.7% done] [  1200/     0 kb/s] [eta 00m:26s]
Threads: 3: [FFm] [32.3% done] [  1184/  9028 kb/s] [eta 00m:21s]
Threads: 3: [FFF] [100.0% done] [     0/ 52960 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.2% done] [ 12848/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [73.1% done] [ 27992/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.9% done] [ 29284/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [84.0% done] [ 26884/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [91.7% done] [ 37300/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 37132/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 29128/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 36780/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 32636/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=14586
  read : io=100MiB, bw=3,901KiB/s, runt= 26874msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  783, avg=60.99, stdev=127.71
    bw (KiB/s) : min=    0, max=17668, per=55.29%, avg=6471.17, stdev=5932.37
  write: io=96,312KiB, bw=5,602KiB/s, runt= 17604msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  243, avg= 1.53, stdev=14.78
    bw (KiB/s) : min=    0, max=120725, per=261.41%, avg=42110.67, stdev=68139.71
  cpu          : usr=3.39%, sys=1.49%, ctx=8517
  IO depths    : 1=1.4%, 2=55.4%, 4=29.9%, 8=13.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.2%, 4=2.0%, 10=21.4%, 20=15.9%, 50=2.1%, 100=0.8%
     lat (msec): 250=6.0%, 500=2.1%, 750=1.2%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14587
  read : io=100MiB, bw=4,003KiB/s, runt= 26186msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  635, avg=47.64, stdev=79.62
    bw (KiB/s) : min=    5, max=16515, per=82.10%, avg=9608.58, stdev=4999.04
  write: io=96,560KiB, bw=5,615KiB/s, runt= 17608msec
    slat (msec): min=    0, max=    7, avg= 0.00, stdev= 0.18
    clat (msec): min=    0, max=   99, avg= 0.51, stdev= 5.00
    bw (KiB/s) : min=    0, max=42882, per=133.10%, avg=21441.00, stdev=30322.15
  cpu          : usr=2.81%, sys=1.48%, ctx=8251
  IO depths    : 1=1.1%, 2=53.9%, 4=31.2%, 8=13.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.4%, 4=0.2%, 10=16.3%, 20=17.8%, 50=5.4%, 100=1.7%
     lat (msec): 250=8.1%, 500=0.9%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14588
  read : io=100MiB, bw=3,945KiB/s, runt= 26577msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1260, avg=86.80, stdev=169.32
    bw (KiB/s) : min=    7, max=15099, per=44.69%, avg=5230.94, stdev=4797.57
  write: io=84,144KiB, bw=4,893KiB/s, runt= 17607msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  742, avg= 7.62, stdev=55.65
    bw (KiB/s) : min=    0, max= 9168, per=12.54%, avg=2019.80, stdev=3999.23
  cpu          : usr=2.96%, sys=1.23%, ctx=8507
  IO depths    : 1=1.6%, 2=49.0%, 4=31.5%, 8=17.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=42.6%, 4=1.8%, 10=15.8%, 20=20.8%, 50=4.4%, 100=0.8%
     lat (msec): 250=8.6%, 500=2.3%, 750=1.8%, 1000=0.7%, >=2000=0.2%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,704KiB/s, minb=3,901KiB/s, maxb=4,003KiB/s, mint=26186msec, maxt=26874msec
  WRITE: io=271MiB, aggrb=16,109KiB/s, minb=4,893KiB/s, maxb=5,615KiB/s, mint=26186msec, maxt=26874msec

Disk stats (read/write):
  sda: ios=3415/2381, merge=1404/66744, ticks=104768/1995152, in_queue=2099920, util=98.73%
2.46user 1.16system 0:27.29elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2480minor)pagefaults 0swaps