fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [42.9% done] [  1442/ 40569 kb/s] [eta 00m:04s]
Threads: 3: [FmF] [40.0% done] [   479/     0 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [  1125/ 43036 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [73.7% done] [  6272/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [68.2% done] [ 15600/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 23348/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [70.8% done] [ 31836/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [78.3% done] [ 37112/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [86.4% done] [ 32004/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.2% done] [ 34360/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 34708/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 32384/     0 kb/s] [eta 00m:00s]
Threads: 1: [_EV] [100.0% done] [ 34236/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=21091
  read : io=100MiB, bw=4,936KiB/s, runt= 21240msec
    slat (msec): min=12667, max=20303, avg=16509.19, stdev=2061.91
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=20700, per=99.47%, avg=13185.64, stdev=6241.09
  write: io=100MiB, bw=7,949KiB/s, runt= 13191msec
    slat (msec): min=    0, max=   11, avg= 1.86, stdev= 1.88
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=113197, per=278.02%, avg=56598.50, stdev=80042.37
  cpu          : usr=5.97%, sys=1.64%, ctx=755
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=21092
  read : io=100MiB, bw=4,523KiB/s, runt= 23182msec
    slat (msec): min=   51, max=18744, avg=14621.58, stdev=4333.89
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=29418, per=64.56%, avg=8558.00, stdev=7128.40
  write: io=95,228KiB, bw=6,647KiB/s, runt= 14670msec
    slat (msec): min=    0, max=   15, avg= 1.91, stdev= 2.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=13243, per=32.53%, avg=6621.50, stdev=9364.22
  cpu          : usr=5.09%, sys=1.52%, ctx=902
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=21093
  read : io=100MiB, bw=4,418KiB/s, runt= 23729msec
    slat (msec): min=   69, max=21189, avg=17260.09, stdev=4373.55
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=22744, per=77.53%, avg=10277.29, stdev=6853.27
  write: io=94,032KiB, bw=6,569KiB/s, runt= 14658msec
    slat (msec): min=    0, max=   11, avg= 1.87, stdev= 2.00
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=32925, per=80.87%, avg=16462.50, stdev=23281.49
  cpu          : usr=5.33%, sys=1.65%, ctx=876
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,256KiB/s, minb=4,418KiB/s, maxb=4,936KiB/s, mint=21240msec, maxt=23729msec
  WRITE: io=285MiB, aggrb=20,358KiB/s, minb=6,569KiB/s, maxb=7,949KiB/s, mint=21240msec, maxt=23729msec

Disk stats (read/write):
  sda: ios=3164/2168, merge=1211/70752, ticks=87544/1793224, in_queue=1880780, util=99.04%
3.77user 1.12system 0:24.02elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps