fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [30.0% done] [  6912/ 52536 kb/s] [eta 00m:07s]
Threads: 3: [FmF] [30.8% done] [  1532/ 39848 kb/s] [eta 00m:09s]
Threads: 3: [FmF] [55.6% done] [  1164/ 33544 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [     0/ 22936 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [    44/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.2% done] [ 20248/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 32568/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [77.3% done] [ 23300/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.7% done] [ 33072/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.0% done] [ 34085/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35012/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32212/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 24600/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 33484/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=21819
  read : io=100MiB, bw=4,396KiB/s, runt= 23849msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  704, avg=54.76, stdev=93.28
    bw (KiB/s) : min=    0, max=17778, per=58.59%, avg=7726.95, stdev=5190.19
  write: io=90,324KiB, bw=6,446KiB/s, runt= 14348msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  314, avg= 1.11, stdev=12.80
    bw (KiB/s) : min=    0, max=134766, per=239.69%, avg=47151.33, stdev=75950.18
  cpu          : usr=3.37%, sys=1.68%, ctx=5178
  IO depths    : 1=2.4%, 2=57.6%, 4=28.9%, 8=11.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.5%, 4=1.4%, 10=18.6%, 20=15.1%, 50=4.0%, 100=1.7%
     lat (msec): 250=8.1%, 500=2.3%, 750=0.1%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=21820
  read : io=100MiB, bw=4,475KiB/s, runt= 23425msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  751, avg=63.49, stdev=112.80
    bw (KiB/s) : min=    3, max=24027, per=54.33%, avg=7165.04, stdev=6217.63
  write: io=87,528KiB, bw=6,245KiB/s, runt= 14352msec
    slat (msec): min=    0, max=    1, avg= 0.00, stdev= 0.03
    clat (msec): min=    0, max=  167, avg= 1.49, stdev=11.58
    bw (KiB/s) : min=    0, max=109887, per=199.09%, avg=39165.67, stdev=61364.55
  cpu          : usr=3.35%, sys=1.76%, ctx=5154
  IO depths    : 1=1.6%, 2=54.6%, 4=30.2%, 8=13.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=46.5%, 4=1.6%, 10=13.6%, 20=17.2%, 50=7.5%, 100=2.4%
     lat (msec): 250=7.4%, 500=2.6%, 750=0.8%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=21821
  read : io=100MiB, bw=4,452KiB/s, runt= 23545msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  491, avg=47.36, stdev=79.33
    bw (KiB/s) : min=    2, max=21480, per=69.62%, avg=9181.67, stdev=6245.10
  write: io=97,872KiB, bw=6,986KiB/s, runt= 14344msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  330, avg= 1.27, stdev=14.92
    bw (KiB/s) : min=    0, max=126468, per=258.67%, avg=50886.00, stdev=66752.96
  cpu          : usr=3.35%, sys=1.89%, ctx=5140
  IO depths    : 1=2.9%, 2=58.9%, 4=28.1%, 8=10.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=50.6%, 4=0.4%, 10=17.1%, 20=16.5%, 50=4.1%, 100=1.3%
     lat (msec): 250=8.2%, 500=1.4%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,188KiB/s, minb=4,396KiB/s, maxb=4,475KiB/s, mint=23425msec, maxt=23849msec
  WRITE: io=269MiB, aggrb=19,672KiB/s, minb=6,245KiB/s, maxb=6,986KiB/s, mint=23425msec, maxt=23849msec

Disk stats (read/write):
  sda: ios=3332/2075, merge=1387/66618, ticks=75148/1707824, in_queue=1787540, util=98.59%
2.43user 1.33system 0:24.16elapsed 15%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2472minor)pagefaults 0swaps