fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [25.0% done] [   956/     0 kb/s] [eta 00m:09s]
Threads: 3: [FmF] [26.7% done] [  1196/   280 kb/s] [eta 00m:11s]
Threads: 3: [FFF] [100.0% done] [    48/ 63468 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  9979/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 24716/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.0% done] [ 32160/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.0% done] [ 35549/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.0% done] [ 31594/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 36472/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 29379/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37270/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34291/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=17797
  read : io=100MiB, bw=4,327KiB/s, runt= 24225msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  714, avg=47.59, stdev=88.42
    bw (KiB/s) : min=    0, max=15835, per=66.23%, avg=8599.61, stdev=4732.62
  write: io=98MiB, bw=7,052KiB/s, runt= 14640msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  183, avg= 1.44, stdev= 8.32
    bw (KiB/s) : min=    0, max=53752, per=131.82%, avg=26876.00, stdev=38008.40
  cpu          : usr=3.29%, sys=1.45%, ctx=5382
  IO depths    : 1=2.3%, 2=52.6%, 4=33.9%, 8=11.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=46.2%, 4=2.4%, 10=21.7%, 20=17.0%, 50=3.6%, 100=0.7%
     lat (msec): 250=6.6%, 500=1.4%, 750=0.1%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17798
  read : io=100MiB, bw=4,419KiB/s, runt= 23727msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  899, avg=56.55, stdev=111.66
    bw (KiB/s) : min=   10, max=15248, per=56.34%, avg=7315.26, stdev=5047.94
  write: io=92,048KiB, bw=6,413KiB/s, runt= 14696msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  691, avg= 4.85, stdev=41.97
    bw (KiB/s) : min=    0, max= 8804, per=14.92%, avg=3042.00, stdev=4992.63
  cpu          : usr=3.52%, sys=1.64%, ctx=5520
  IO depths    : 1=3.2%, 2=50.0%, 4=33.1%, 8=13.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=44.7%, 4=1.5%, 10=17.3%, 20=20.7%, 50=4.8%, 100=1.6%
     lat (msec): 250=6.5%, 500=1.9%, 750=0.8%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17799
  read : io=100MiB, bw=4,340KiB/s, runt= 24157msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  614, avg=47.85, stdev=94.88
    bw (KiB/s) : min=    3, max=15289, per=68.46%, avg=8889.39, stdev=5336.54
  write: io=99,744KiB, bw=6,953KiB/s, runt= 14688msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  226, avg= 1.89, stdev=10.54
    bw (KiB/s) : min=    0, max=117915, per=229.48%, avg=46789.00, stdev=62611.53
  cpu          : usr=3.91%, sys=1.76%, ctx=5659
  IO depths    : 1=4.2%, 2=51.8%, 4=32.9%, 8=11.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=46.1%, 4=2.2%, 10=17.0%, 20=22.4%, 50=3.9%, 100=0.2%
     lat (msec): 250=6.0%, 500=1.4%, 750=0.6%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,984KiB/s, minb=4,327KiB/s, maxb=4,419KiB/s, mint=23727msec, maxt=24225msec
  WRITE: io=286MiB, aggrb=20,389KiB/s, minb=6,413KiB/s, maxb=7,052KiB/s, mint=23727msec, maxt=24225msec

Disk stats (read/write):
  sda: ios=3112/1946, merge=1293/70993, ticks=114512/1830344, in_queue=1951708, util=97.25%
2.63user 1.22system 0:24.73elapsed 15%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2471minor)pagefaults 0swaps