fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [42.9% done] [   552/ 73616 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [40.0% done] [     0/     0 kb/s] [eta 00m:06s]
Threads: 3: [FFm] [41.7% done] [   468/     0 kb/s] [eta 00m:07s]
Threads: 3: [FFm] [40.0% done] [   648/     0 kb/s] [eta 00m:09s]
Threads: 3: [FFF] [100.0% done] [   548/ 41728 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [ 14684/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 27664/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [81.0% done] [ 30220/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.0% done] [ 33696/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 37544/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33280/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 38700/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 29624/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 31752/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=25444
  read : io=100MiB, bw=4,444KiB/s, runt= 23593msec
    slat (msec): min=  354, max=21848, avg=17786.50, stdev=2921.19
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=21204, per=78.08%, avg=10344.94, stdev=5879.35
  write: io=99MiB, bw=7,266KiB/s, runt= 14266msec
    slat (msec): min=    0, max=   15, avg= 1.89, stdev= 2.04
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=42002, per=101.82%, avg=21001.00, stdev=29699.90
  cpu          : usr=5.27%, sys=1.85%, ctx=769
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25445
  read : io=100MiB, bw=4,496KiB/s, runt= 23322msec
    slat (msec): min=  139, max=20992, avg=16579.49, stdev=3985.64
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=20535, per=73.29%, avg=9709.56, stdev=5868.27
  write: io=95,880KiB, bw=6,873KiB/s, runt= 14285msec
    slat (msec): min=    0, max=   17, avg= 1.96, stdev= 2.27
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=98099, per=237.82%, avg=49049.50, stdev=69366.47
  cpu          : usr=5.68%, sys=1.63%, ctx=861
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25446
  read : io=100MiB, bw=4,416KiB/s, runt= 23742msec
    slat (msec): min=   85, max=17360, avg=12539.34, stdev=3934.99
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=17972, per=56.27%, avg=7455.55, stdev=5726.87
  write: io=90,628KiB, bw=6,498KiB/s, runt= 14281msec
    slat (msec): min=    0, max=   20, avg= 1.77, stdev= 2.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=11538, per=27.97%, avg=5769.00, stdev=8158.60
  cpu          : usr=5.36%, sys=1.47%, ctx=920
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,249KiB/s, minb=4,416KiB/s, maxb=4,496KiB/s, mint=23322msec, maxt=23742msec
  WRITE: io=281MiB, aggrb=20,625KiB/s, minb=6,498KiB/s, maxb=7,266KiB/s, mint=23322msec, maxt=23742msec

Disk stats (read/write):
  sda: ios=3176/2425, merge=1328/69391, ticks=84340/1668016, in_queue=1754452, util=98.79%
3.89user 1.16system 0:24.01elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2419minor)pagefaults 0swaps