fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [   764/ 53720 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  8024/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [68.0% done] [ 32244/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 33480/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [73.1% done] [ 34728/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [74.1% done] [ 29016/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [80.8% done] [ 23130/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [91.7% done] [ 38408/     0 kb/s] [eta 00m:02s]
Threads: 2: [V_V] [100.0% done] [ 33148/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 40116/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=11582
  read : io=100MiB, bw=4,209KiB/s, runt= 24910msec
    slat (msec): min=  100, max=23269, avg=20949.65, stdev=3533.94
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=41559, per=91.59%, avg=11565.67, stdev=13816.59
  write: io=98MiB, bw=6,663KiB/s, runt= 15384msec
    slat (msec): min=    0, max=  104, avg= 2.10, stdev= 5.42
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=93061, per=160.43%, avg=31167.33, stdev=53601.94
  cpu          : usr=5.01%, sys=1.41%, ctx=882
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=11583
  read : io=100MiB, bw=4,544KiB/s, runt= 23076msec
    slat (msec): min=   80, max=20228, avg=15768.82, stdev=3669.20
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=19604, per=81.90%, avg=10342.24, stdev=6484.26
  write: io=94,972KiB, bw=6,324KiB/s, runt= 15376msec
    slat (msec): min=    0, max=  200, avg= 2.12, stdev= 8.77
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=80795, per=139.13%, avg=27028.00, stdev=46563.81
  cpu          : usr=5.17%, sys=1.54%, ctx=975
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=11584
  read : io=100MiB, bw=4,400KiB/s, runt= 23830msec
    slat (msec): min=   47, max=21805, avg=17526.18, stdev=4032.55
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   15, max=21607, per=80.26%, avg=10134.67, stdev=6059.92
  write: io=96,864KiB, bw=6,445KiB/s, runt= 15388msec
    slat (msec): min=    0, max=  116, avg= 2.08, stdev= 6.00
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=92190, per=170.31%, avg=33086.33, stdev=51307.17
  cpu          : usr=5.17%, sys=1.44%, ctx=971
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,628KiB/s, minb=4,209KiB/s, maxb=4,544KiB/s, mint=23076msec, maxt=24910msec
  WRITE: io=285MiB, aggrb=19,427KiB/s, minb=6,324KiB/s, maxb=6,663KiB/s, mint=23076msec, maxt=24910msec

Disk stats (read/write):
  sda: ios=3130/2201, merge=1452/70704, ticks=80112/1864660, in_queue=1945144, util=98.57%
3.72user 1.07system 0:25.28elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2424minor)pagefaults 0swaps