fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [42.9% done] [  2316/ 81272 kb/s] [eta 00m:04s]
Threads: 3: [mFF] [40.0% done] [   540/ 12192 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [   456/ 42540 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.6% done] [ 13440/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 29500/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.8% done] [ 34504/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [86.4% done] [ 25744/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.2% done] [ 39332/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35132/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37480/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 29076/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [100.0% done] [ 35172/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=1658
  read : io=100MiB, bw=4,249KiB/s, runt= 24675msec
    slat (msec): min=  150, max=19982, avg=15474.97, stdev=3895.74
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=15975, per=60.36%, avg=7692.00, stdev=5492.11
  write: io=95,208KiB, bw=6,407KiB/s, runt= 15215msec
    slat (msec): min=    0, max=  382, avg= 2.49, stdev=16.51
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=61557, per=105.79%, avg=20563.67, stdev=35501.33
  cpu          : usr=4.67%, sys=1.46%, ctx=939
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1659
  read : io=100MiB, bw=4,247KiB/s, runt= 24685msec
    slat (msec): min=   63, max=21667, avg=16710.43, stdev=4405.97
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=21611, per=71.92%, avg=9164.33, stdev=4984.64
  write: io=93,196KiB, bw=6,272KiB/s, runt= 15215msec
    slat (msec): min=    0, max=  153, avg= 2.38, stdev=10.81
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=117399, per=301.97%, avg=58699.50, stdev=83013.63
  cpu          : usr=5.19%, sys=1.25%, ctx=973
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1660
  read : io=100MiB, bw=4,306KiB/s, runt= 24346msec
    slat (msec): min=  260, max=22920, avg=18849.05, stdev=2969.66
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=17777, per=81.48%, avg=10383.25, stdev=5357.40
  write: io=98MiB, bw=6,767KiB/s, runt= 15224msec
    slat (msec): min=    0, max=   10, avg= 1.82, stdev= 1.81
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=116939, per=300.78%, avg=58469.50, stdev=82688.36
  cpu          : usr=5.09%, sys=1.41%, ctx=976
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,743KiB/s, minb=4,247KiB/s, maxb=4,306KiB/s, mint=24346msec, maxt=24685msec
  WRITE: io=282MiB, aggrb=19,439KiB/s, minb=6,272KiB/s, maxb=6,767KiB/s, mint=24346msec, maxt=24685msec

Disk stats (read/write):
  sda: ios=3125/2031, merge=1569/70073, ticks=105124/1920824, in_queue=2026332, util=98.68%
3.75user 1.01system 0:25.05elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2420minor)pagefaults 0swaps