fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [     0/140712 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  7460/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [71.4% done] [ 25067/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [76.2% done] [ 28164/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.0% done] [ 28724/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [94.7% done] [ 33109/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 37904/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34811/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30216/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 29923/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 35104/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=18365
  read : io=100MiB, bw=4,539KiB/s, runt= 23097msec
    slat (msec): min=   79, max=20342, avg=15821.77, stdev=4004.66
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=21543, per=68.94%, avg=9388.82, stdev=6223.48
  write: io=93,628KiB, bw=7,154KiB/s, runt= 13401msec
    slat (msec): min=    0, max=   18, avg= 2.14, stdev= 2.75
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=92663, per=210.83%, avg=46331.50, stdev=65522.64
  cpu          : usr=5.56%, sys=1.49%, ctx=796
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=18366
  read : io=100MiB, bw=4,640KiB/s, runt= 22596msec
    slat (msec): min=  179, max=20618, avg=16271.04, stdev=3765.93
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=17592, per=72.11%, avg=9821.00, stdev=6063.07
  write: io=97,080KiB, bw=7,420KiB/s, runt= 13397msec
    slat (msec): min=    0, max=   10, avg= 1.75, stdev= 1.88
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114337, per=260.14%, avg=57168.50, stdev=80848.47
  cpu          : usr=5.03%, sys=2.14%, ctx=795
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=18367
  read : io=100MiB, bw=4,560KiB/s, runt= 22995msec
    slat (msec): min=   36, max=20686, avg=15873.15, stdev=3890.20
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=20512, per=62.38%, avg=8496.11, stdev=6145.60
  write: io=96,892KiB, bw=7,405KiB/s, runt= 13397msec
    slat (msec): min=    0, max=   48, avg= 2.20, stdev= 3.07
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=103854, per=158.79%, avg=34896.00, stdev=59720.84
  cpu          : usr=5.62%, sys=1.64%, ctx=845
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,619KiB/s, minb=4,539KiB/s, maxb=4,640KiB/s, mint=22596msec, maxt=23097msec
  WRITE: io=281MiB, aggrb=21,976KiB/s, minb=7,154KiB/s, maxb=7,420KiB/s, mint=22596msec, maxt=23097msec

Disk stats (read/write):
  sda: ios=3111/1988, merge=1495/69711, ticks=77040/1595088, in_queue=1676392, util=98.27%
3.76user 1.24system 0:23.37elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps