fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [5.8% done] [   846/ 32673 kb/s] [eta 00m:49s]
Threads: 3: [FFm] [44.4% done] [  1059/ 55559 kb/s] [eta 00m:05s]
Threads: 3: [FFF] [100.0% done] [   787/ 34855 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [70.0% done] [  9291/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [71.4% done] [ 31076/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 28708/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [89.5% done] [ 30032/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [94.7% done] [ 36888/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35628/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34636/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33460/     0 kb/s] [eta 00m:00s]
Threads: 2: [VEV] [100.0% done] [ 34740/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=15309
  read : io=100MiB, bw=4,616KiB/s, runt= 22715msec
    slat (msec): min=12656, max=21770, avg=18065.27, stdev=2317.69
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=14588, per=77.63%, avg=10619.13, stdev=4519.61
  write: io=100MiB, bw=7,767KiB/s, runt= 13500msec
    slat (msec): min=    0, max=   14, avg= 2.08, stdev= 2.29
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111826, per=256.48%, avg=55913.00, stdev=79072.92
  cpu          : usr=5.27%, sys=1.53%, ctx=730
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15310
  read : io=100MiB, bw=4,650KiB/s, runt= 22547msec
    slat (msec): min=  122, max=20317, avg=15567.43, stdev=4102.78
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=24044, per=71.75%, avg=9815.35, stdev=6173.21
  write: io=94,716KiB, bw=7,146KiB/s, runt= 13572msec
    slat (msec): min=    0, max=   12, avg= 1.76, stdev= 2.02
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=117181, per=268.76%, avg=58590.50, stdev=82859.48
  cpu          : usr=5.52%, sys=1.51%, ctx=921
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15311
  read : io=100MiB, bw=4,560KiB/s, runt= 22994msec
    slat (msec): min=   97, max=18136, avg=13493.19, stdev=4007.07
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=18195, per=57.82%, avg=7909.50, stdev=5318.53
  write: io=91,828KiB, bw=6,932KiB/s, runt= 13564msec
    slat (msec): min=    0, max=  101, avg= 1.83, stdev= 5.70
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=98054, per=171.94%, avg=37483.67, stdev=52947.07
  cpu          : usr=5.20%, sys=1.53%, ctx=945
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,680KiB/s, minb=4,560KiB/s, maxb=4,650KiB/s, mint=22547msec, maxt=22994msec
  WRITE: io=282MiB, aggrb=21,800KiB/s, minb=6,932KiB/s, maxb=7,767KiB/s, mint=22547msec, maxt=22994msec

Disk stats (read/write):
  sda: ios=3179/2137, merge=1086/69930, ticks=71672/1790740, in_queue=1862732, util=99.14%
3.68user 1.04system 0:23.43elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2410minor)pagefaults 0swaps