fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [50.0% done] [  1127/  2690 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [     0/ 34440 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [ 10056/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.2% done] [ 32348/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [77.3% done] [ 35252/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [81.8% done] [ 26216/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [95.0% done] [ 38196/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 37112/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30320/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34408/     0 kb/s] [eta 00m:00s]
Threads: 1: [VE_] [100.0% done] [ 38344/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=11592
  read : io=100MiB, bw=4,383KiB/s, runt= 23914msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  651, avg=50.57, stdev=107.89
    bw (KiB/s) : min=    0, max=16619, per=58.21%, avg=7651.30, stdev=5631.11
  write: io=98,328KiB, bw=6,953KiB/s, runt= 14480msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  519, avg= 2.03, stdev=22.43
    bw (KiB/s) : min=    0, max=109051, per=225.60%, avg=46938.00, stdev=56086.90
  cpu          : usr=3.53%, sys=1.54%, ctx=5451
  IO depths    : 1=2.5%, 2=55.7%, 4=31.2%, 8=10.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.5%, 4=1.2%, 10=26.5%, 20=11.9%, 50=3.6%, 100=0.3%
     lat (msec): 250=5.5%, 500=1.6%, 750=0.8%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=11593
  read : io=100MiB, bw=4,437KiB/s, runt= 23607msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  891, avg=53.60, stdev=109.11
    bw (KiB/s) : min=    4, max=15159, per=58.57%, avg=7699.45, stdev=5076.08
  write: io=95,436KiB, bw=6,750KiB/s, runt= 14476msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  543, avg= 1.55, stdev=21.84
    bw (KiB/s) : min=    0, max=19642, per=47.20%, avg=9821.00, stdev=13888.99
  cpu          : usr=3.37%, sys=1.47%, ctx=5625
  IO depths    : 1=1.3%, 2=54.6%, 4=31.0%, 8=13.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.4%, 4=0.3%, 10=21.4%, 20=14.3%, 50=5.4%, 100=1.1%
     lat (msec): 250=6.2%, 500=1.9%, 750=0.4%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=11594
  read : io=100MiB, bw=4,501KiB/s, runt= 23274msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  654, avg=46.06, stdev=93.92
    bw (KiB/s) : min=    9, max=22634, per=78.95%, avg=10378.56, stdev=6063.54
  write: io=98MiB, bw=7,119KiB/s, runt= 14448msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  302, avg= 0.91, stdev=12.95
    bw (KiB/s) : min=    0, max=141025, per=338.90%, avg=70512.50, stdev=99719.73
  cpu          : usr=3.18%, sys=1.62%, ctx=5114
  IO depths    : 1=1.3%, 2=56.3%, 4=31.7%, 8=10.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=51.1%, 4=0.1%, 10=21.1%, 20=15.3%, 50=4.7%, 100=0.2%
     lat (msec): 250=5.3%, 500=1.5%, 750=0.4%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,145KiB/s, minb=4,383KiB/s, maxb=4,501KiB/s, mint=23274msec, maxt=23914msec
  WRITE: io=287MiB, aggrb=20,806KiB/s, minb=6,750KiB/s, maxb=7,119KiB/s, mint=23274msec, maxt=23914msec

Disk stats (read/write):
  sda: ios=3099/1958, merge=1294/71439, ticks=99684/1855236, in_queue=1957308, util=98.94%
2.44user 1.14system 0:24.29elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2472minor)pagefaults 0swaps