fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [42.9% done] [  6734/ 50672 kb/s] [eta 00m:04s]
Threads: 3: [FmF] [44.4% done] [  3450/ 31196 kb/s] [eta 00m:05s]
Threads: 3: [FmF] [45.5% done] [  1012/   677 kb/s] [eta 00m:06s]
Threads: 3: [FmF] [46.2% done] [   988/     0 kb/s] [eta 00m:07s]
Threads: 3: [FmF] [46.7% done] [   925/     0 kb/s] [eta 00m:08s]
Threads: 3: [FmF] [47.1% done] [   697/     0 kb/s] [eta 00m:09s]
Threads: 3: [FmF] [47.4% done] [   909/   389 kb/s] [eta 00m:10s]
Threads: 3: [FFF] [100.0% done] [   346/ 29495 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.0% done] [   295/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 17486/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [76.0% done] [ 25674/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.8% done] [ 30456/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [88.0% done] [ 27722/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.8% done] [ 33409/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35536/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 29672/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 31373/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 34626/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=14194
  read : io=100MiB, bw=3,864KiB/s, runt= 27134msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  691, avg=53.12, stdev=96.37
    bw (KiB/s) : min=    6, max=16093, per=64.19%, avg=7440.64, stdev=4810.29
  write: io=94,928KiB, bw=5,545KiB/s, runt= 17528msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  242, avg= 1.26, stdev=12.03
    bw (KiB/s) : min=    0, max=117121, per=272.32%, avg=43158.00, stdev=64350.94
  cpu          : usr=3.54%, sys=1.55%, ctx=5583
  IO depths    : 1=3.6%, 2=58.7%, 4=27.0%, 8=10.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.1%, 4=2.2%, 10=15.8%, 20=17.9%, 50=5.4%, 100=0.4%
     lat (msec): 250=7.7%, 500=2.0%, 750=0.4%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14195
  read : io=100MiB, bw=3,986KiB/s, runt= 26295msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  811, avg=83.10, stdev=139.24
    bw (KiB/s) : min=   26, max=12207, per=44.92%, avg=5207.24, stdev=4276.70
  write: io=82,504KiB, bw=4,821KiB/s, runt= 17524msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  535, avg= 4.89, stdev=40.19
    bw (KiB/s) : min=    0, max=20647, per=33.40%, avg=5293.00, stdev=10237.16
  cpu          : usr=2.51%, sys=1.51%, ctx=5533
  IO depths    : 1=2.9%, 2=54.4%, 4=27.2%, 8=15.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=46.3%, 4=0.1%, 10=11.6%, 20=17.4%, 50=8.2%, 100=1.6%
     lat (msec): 250=9.9%, 500=2.7%, 750=1.9%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14196
  read : io=100MiB, bw=3,911KiB/s, runt= 26810msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  756, avg=59.03, stdev=95.60
    bw (KiB/s) : min=    2, max=16558, per=63.43%, avg=7352.48, stdev=5406.40
  write: io=93,976KiB, bw=5,487KiB/s, runt= 17536msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  131, avg= 1.22, stdev= 7.04
    bw (KiB/s) : min=    0, max=36145, per=102.54%, avg=16250.67, stdev=18345.91
  cpu          : usr=3.48%, sys=1.37%, ctx=5529
  IO depths    : 1=2.6%, 2=54.0%, 4=30.5%, 8=12.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=44.3%, 4=2.4%, 10=14.8%, 20=16.0%, 50=9.9%, 100=1.3%
     lat (msec): 250=9.2%, 500=1.9%, 750=0.2%, 1000=0.1%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,591KiB/s, minb=3,864KiB/s, maxb=3,986KiB/s, mint=26295msec, maxt=27134msec
  WRITE: io=265MiB, aggrb=15,848KiB/s, minb=4,821KiB/s, maxb=5,545KiB/s, mint=26295msec, maxt=27134msec

Disk stats (read/write):
  sda: ios=3636/2246, merge=1585/65470, ticks=107792/2014076, in_queue=2124080, util=98.14%
2.61user 1.23system 0:27.72elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2475minor)pagefaults 0swaps