fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [33.3% done] [   524/     0 kb/s] [eta 00m:06s]
Threads: 3: [mFm] [33.3% done] [    32/     0 kb/s] [eta 00m:08s]
Threads: 3: [mFm] [33.3% done] [   152/     0 kb/s] [eta 00m:10s]
Threads: 3: [mFm] [35.3% done] [   108/     0 kb/s] [eta 00m:11s]
Threads: 3: [FFm] [35.0% done] [   432/ 39872 kb/s] [eta 00m:13s]
Threads: 3: [FFm] [34.8% done] [   228/     0 kb/s] [eta 00m:15s]
Threads: 3: [FFm] [34.6% done] [     0/     0 kb/s] [eta 00m:17s]
Threads: 3: [FFm] [34.5% done] [   252/     0 kb/s] [eta 00m:19s]
Threads: 3: [FFm] [34.4% done] [   456/   192 kb/s] [eta 00m:21s]
Threads: 3: [VVm] [36.4% done] [  4596/     0 kb/s] [eta 00m:21s]
Threads: 3: [VVm] [36.1% done] [ 25828/     0 kb/s] [eta 00m:23s]
Threads: 3: [VVm] [36.8% done] [ 33628/     0 kb/s] [eta 00m:24s]
Threads: 3: [VVm] [36.6% done] [ 32620/     0 kb/s] [eta 00m:26s]
Threads: 3: [VVm] [36.4% done] [ 26380/     0 kb/s] [eta 00m:28s]
Threads: 3: [VVm] [37.0% done] [ 35644/   800 kb/s] [eta 00m:29s]
Threads: 2: [_Vm] [37.5% done] [ 30692/     0 kb/s] [eta 00m:30s]
Threads: 1: [__m] [50.0% done] [ 16336/ 12884 kb/s] [eta 00m:19s]
Threads: 1: [__F] [100.0% done] [     0/ 26973 kb/s] [eta 00m:00s]
Threads: 1: [__F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [71.0% done] [  5282/     0 kb/s] [eta 00m:09s]
Threads: 1: [__V] [92.0% done] [ 31248/     0 kb/s] [eta 00m:02s]
Threads: 1: [__V] [100.0% done] [ 35315/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=3597
  read : io=100MiB, bw=5,769KiB/s, runt= 18174msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 4072, avg=53.38, stdev=250.66
    bw (KiB/s) : min=    0, max=24130, per=68.26%, avg=8562.60, stdev=8770.25
  write: io=98,000KiB, bw=8,318KiB/s, runt= 12064msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 2827, avg= 5.76, stdev=107.20
    bw (KiB/s) : min=    0, max= 8668, per=33.17%, avg=4334.00, stdev=6129.20
  cpu          : usr=4.56%, sys=2.20%, ctx=6419
  IO depths    : 1=1.2%, 2=54.5%, 4=30.6%, 8=13.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.1%, 4=1.8%, 10=17.2%, 20=16.7%, 50=5.4%, 100=2.4%
     lat (msec): 250=6.4%, 500=0.3%, 750=0.1%, 1000=0.1%, >=2000=0.2%
fio: (groupid=0): err= 0: pid=3598
  read : io=100MiB, bw=5,559KiB/s, runt= 18862msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  255, avg=33.15, stdev=50.45
    bw (KiB/s) : min=   14, max=32256, per=104.76%, avg=13142.71, stdev=7318.93
  write: io=98,268KiB, bw=8,332KiB/s, runt= 12076msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  171, avg= 0.64, stdev= 7.66
    bw (KiB/s) : min=    0, max=122806, per=469.98%, avg=61403.00, stdev=86836.96
  cpu          : usr=4.54%, sys=2.42%, ctx=6601
  IO depths    : 1=1.1%, 2=54.8%, 4=31.4%, 8=12.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.7%, 4=1.2%, 10=17.3%, 20=16.8%, 50=6.5%, 100=0.9%
     lat (msec): 250=7.4%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=3599
  read : io=100MiB, bw=4,181KiB/s, runt= 25073msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 4394, avg=85.96, stdev=375.05
    bw (KiB/s) : min=    4, max=35962, per=46.49%, avg=5831.69, stdev=11317.14
  write: io=84,288KiB, bw=3,925KiB/s, runt= 21988msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 3955, avg=18.25, stdev=217.27
    bw (KiB/s) : min=    0, max= 7884, per=15.55%, avg=2032.00, stdev=3271.24
  cpu          : usr=2.58%, sys=1.60%, ctx=8344
  IO depths    : 1=1.1%, 2=49.1%, 4=30.8%, 8=19.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=46.2%, 4=2.5%, 10=13.7%, 20=24.3%, 50=4.8%, 100=3.0%
     lat (msec): 250=2.2%, 500=0.5%, 750=0.5%, 1000=0.5%, >=2000=1.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,545KiB/s, minb=4,181KiB/s, maxb=5,769KiB/s, mint=18174msec, maxt=25073msec
  WRITE: io=274MiB, aggrb=13,065KiB/s, minb=3,925KiB/s, maxb=8,332KiB/s, mint=18174msec, maxt=25073msec

Disk stats (read/write):
  sda: ios=3439/2568, merge=1246/67440, ticks=66916/1736704, in_queue=1810824, util=97.56%
2.38user 1.31system 0:25.49elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2476minor)pagefaults 0swaps