fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [23.1% done] [   688/     0 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [23.5% done] [   899/   403 kb/s] [eta 00m:13s]
Threads: 3: [Fmm] [22.7% done] [   491/ 56043 kb/s] [eta 00m:17s]
Threads: 3: [Fmm] [23.1% done] [   711/   199 kb/s] [eta 00m:20s]
Threads: 3: [Fmm] [23.3% done] [   719/     0 kb/s] [eta 00m:23s]
Threads: 3: [Fmm] [23.5% done] [   585/     0 kb/s] [eta 00m:26s]
Threads: 3: [Fmm] [23.7% done] [    56/     0 kb/s] [eta 00m:29s]
Threads: 3: [Vmm] [33.3% done] [   597/ 15506 kb/s] [eta 00m:20s]
Threads: 3: [Vmm] [42.3% done] [ 21058/ 46804 kb/s] [eta 00m:15s]
Threads: 3: [VmF] [42.9% done] [ 20763/  3116 kb/s] [eta 00m:16s]
Threads: 3: [VmF] [43.3% done] [   182/     0 kb/s] [eta 00m:17s]
Threads: 3: [VmF] [43.8% done] [   300/     0 kb/s] [eta 00m:18s]
Threads: 3: [VmV] [44.1% done] [  8691/     0 kb/s] [eta 00m:19s]
Threads: 3: [VmV] [44.4% done] [ 25827/     0 kb/s] [eta 00m:20s]
Threads: 3: [VmV] [43.6% done] [ 35067/     0 kb/s] [eta 00m:22s]
Threads: 3: [VmV] [43.9% done] [ 31894/   121 kb/s] [eta 00m:23s]
Threads: 2: [_mV] [47.5% done] [ 30614/  4697 kb/s] [eta 00m:21s]
Threads: 2: [_FV] [100.0% done] [ 11218/ 30327 kb/s] [eta 00m:00s]
Threads: 2: [_FV] [100.0% done] [   503/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [71.0% done] [ 15116/     0 kb/s] [eta 00m:09s]
Threads: 1: [_V_] [88.5% done] [ 33024/     0 kb/s] [eta 00m:03s]
Threads: 1: [_V_] [100.0% done] [ 30500/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=11219
  read : io=100MiB, bw=5,625KiB/s, runt= 18640msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 3351, avg=54.42, stdev=248.51
    bw (KiB/s) : min=    0, max=22081, per=75.71%, avg=9433.10, stdev=8787.96
  write: io=97,864KiB, bw=9,879KiB/s, runt= 10144msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1711, avg= 3.02, stdev=51.37
    bw (KiB/s) : min=    0, max=11040, per=41.35%, avg=5520.00, stdev=7806.46
  cpu          : usr=4.64%, sys=2.47%, ctx=6700
  IO depths    : 1=1.3%, 2=54.4%, 4=31.0%, 8=13.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.6%, 4=3.2%, 10=15.8%, 20=16.5%, 50=5.9%, 100=2.4%
     lat (msec): 250=5.6%, 500=0.1%, 750=0.0%, 1000=0.2%, >=2000=0.2%
fio: (groupid=0): err= 0: pid=11220
  read : io=100MiB, bw=4,153KiB/s, runt= 25245msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 3436, avg=90.82, stdev=349.39
    bw (KiB/s) : min=    4, max=34283, per=42.96%, avg=5352.71, stdev=10998.19
  write: io=92,984KiB, bw=4,359KiB/s, runt= 21840msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 2683, avg=19.87, stdev=170.45
    bw (KiB/s) : min=    0, max=14389, per=16.15%, avg=2156.00, stdev=5395.25
  cpu          : usr=3.28%, sys=1.60%, ctx=8170
  IO depths    : 1=0.8%, 2=47.4%, 4=33.4%, 8=18.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=44.6%, 4=3.7%, 10=13.0%, 20=26.0%, 50=5.3%, 100=2.2%
     lat (msec): 250=1.6%, 500=0.2%, 750=0.7%, 1000=0.6%, >=2000=1.3%
fio: (groupid=0): err= 0: pid=11221
  read : io=100MiB, bw=4,631KiB/s, runt= 22637msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 4155, avg=76.24, stdev=304.46
    bw (KiB/s) : min=   11, max=29785, per=52.67%, avg=6562.69, stdev=8806.77
  write: io=93,888KiB, bw=6,445KiB/s, runt= 14916msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 2708, avg=11.56, stdev=158.06
    bw (KiB/s) : min=    0, max=124510, per=239.34%, avg=31951.50, stdev=61724.56
  cpu          : usr=3.48%, sys=2.01%, ctx=7713
  IO depths    : 1=0.9%, 2=51.6%, 4=31.0%, 8=16.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=47.4%, 4=2.5%, 10=10.9%, 20=20.3%, 50=8.4%, 100=2.0%
     lat (msec): 250=5.9%, 500=0.8%, 750=0.5%, 1000=0.1%, >=2000=0.6%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,459KiB/s, minb=4,153KiB/s, maxb=5,625KiB/s, mint=18640msec, maxt=25245msec
  WRITE: io=278MiB, aggrb=13,350KiB/s, minb=4,359KiB/s, maxb=9,879KiB/s, mint=18640msec, maxt=25245msec

Disk stats (read/write):
  sda: ios=3432/2841, merge=1009/68328, ticks=85244/1725228, in_queue=1810636, util=98.44%
2.54user 1.38system 0:25.91elapsed 15%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2476minor)pagefaults 0swaps