fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [5.0% done] [  2130/ 40038 kb/s] [eta 00m:57s]
Threads: 3: [mmF] [57.1% done] [  1350/ 90131 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [   291/ 23303 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [ 10275/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 31648/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [70.8% done] [ 30596/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [75.0% done] [ 31856/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [82.6% done] [ 33132/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.9% done] [ 35848/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 29500/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34480/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 35480/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=11648
  read : io=100MiB, bw=4,296KiB/s, runt= 24406msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  720, avg=59.16, stdev=123.84
    bw (KiB/s) : min=    8, max=20824, per=50.40%, avg=6495.65, stdev=6451.74
  write: io=96,600KiB, bw=6,745KiB/s, runt= 14664msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  451, avg= 3.64, stdev=33.85
    bw (KiB/s) : min=    0, max=128341, per=167.68%, avg=34350.25, stdev=62697.47
  cpu          : usr=3.20%, sys=1.52%, ctx=5320
  IO depths    : 1=3.4%, 2=58.7%, 4=27.6%, 8=10.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=50.4%, 4=0.2%, 10=20.5%, 20=14.8%, 50=4.4%, 100=0.5%
     lat (msec): 250=4.7%, 500=3.4%, 750=1.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=11649
  read : io=100MiB, bw=4,480KiB/s, runt= 23405msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  966, avg=54.42, stdev=114.88
    bw (KiB/s) : min=   17, max=16570, per=61.96%, avg=7986.05, stdev=5709.47
  write: io=96,000KiB, bw=6,703KiB/s, runt= 14664msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  802, avg= 3.54, stdev=41.83
    bw (KiB/s) : min=    0, max=139419, per=227.76%, avg=46657.33, stdev=80334.44
  cpu          : usr=3.09%, sys=1.50%, ctx=5138
  IO depths    : 1=2.6%, 2=58.3%, 4=29.2%, 8=9.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=50.6%, 4=0.2%, 10=17.2%, 20=17.3%, 50=4.7%, 100=0.3%
     lat (msec): 250=6.7%, 500=1.9%, 750=0.7%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=11650
  read : io=100MiB, bw=4,413KiB/s, runt= 23758msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  654, avg=47.08, stdev=94.37
    bw (KiB/s) : min=    0, max=20480, per=73.02%, avg=9411.84, stdev=6198.02
  write: io=98MiB, bw=7,039KiB/s, runt= 14656msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  434, avg= 1.30, stdev=17.41
    bw (KiB/s) : min=    0, max=30097, per=73.46%, avg=15048.50, stdev=21281.79
  cpu          : usr=3.32%, sys=1.43%, ctx=5372
  IO depths    : 1=2.6%, 2=59.5%, 4=28.9%, 8=9.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=51.7%, 4=0.1%, 10=16.7%, 20=18.6%, 50=4.1%, 100=0.2%
     lat (msec): 250=6.1%, 500=1.9%, 750=0.5%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,889KiB/s, minb=4,296KiB/s, maxb=4,480KiB/s, mint=23405msec, maxt=24406msec
  WRITE: io=286MiB, aggrb=20,485KiB/s, minb=6,703KiB/s, maxb=7,039KiB/s, mint=23405msec, maxt=24406msec

Disk stats (read/write):
  sda: ios=3119/1894, merge=1357/71270, ticks=96212/1967852, in_queue=2074688, util=97.94%
2.35user 1.11system 0:24.85elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2473minor)pagefaults 0swaps