fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [7.3% done] [  1176/ 28088 kb/s] [eta 00m:38s]
Threads: 3: [mFF] [50.0% done] [  1108/ 56376 kb/s] [eta 00m:04s]
Threads: 3: [mFF] [45.5% done] [   832/     0 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [46.2% done] [  1048/     0 kb/s] [eta 00m:07s]
Threads: 3: [FFF] [100.0% done] [   732/ 31228 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  4732/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.2% done] [ 27080/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 30784/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.0% done] [ 28552/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.0% done] [ 34980/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.0% done] [ 35148/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35100/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32948/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 27820/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=12649
  read : io=100MiB, bw=4,536KiB/s, runt= 23113msec
    slat (msec): min=   78, max=16197, avg=11548.73, stdev=3888.96
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=20215, per=53.58%, avg=7273.50, stdev=6389.26
  write: io=87,604KiB, bw=6,571KiB/s, runt= 13651msec
    slat (msec): min=    0, max=   10, avg= 1.55, stdev= 1.74
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=17982, per=42.05%, avg=8991.00, stdev=12715.19
  cpu          : usr=5.36%, sys=1.16%, ctx=1022
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12650
  read : io=100MiB, bw=4,525KiB/s, runt= 23170msec
    slat (msec): min=   72, max=21017, avg=16230.75, stdev=4553.37
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=18954, per=66.80%, avg=9068.11, stdev=5805.43
  write: io=95,024KiB, bw=7,134KiB/s, runt= 13639msec
    slat (msec): min=    0, max=   76, avg= 2.01, stdev= 4.53
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=98507, per=154.49%, avg=33030.00, stdev=56705.49
  cpu          : usr=5.04%, sys=1.73%, ctx=926
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12651
  read : io=100MiB, bw=4,561KiB/s, runt= 22988msec
    slat (msec): min=12949, max=22061, avg=17523.58, stdev=2288.55
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=23628, per=79.70%, avg=10819.41, stdev=6644.33
  write: io=100MiB, bw=7,741KiB/s, runt= 13545msec
    slat (msec): min=    0, max=   13, avg= 1.82, stdev= 2.00
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=116450, per=272.33%, avg=58225.00, stdev=82342.58
  cpu          : usr=5.60%, sys=1.77%, ctx=746
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,576KiB/s, minb=4,525KiB/s, maxb=4,561KiB/s, mint=22988msec, maxt=23170msec
  WRITE: io=278MiB, aggrb=21,380KiB/s, minb=6,571KiB/s, maxb=7,741KiB/s, mint=22988msec, maxt=23170msec

Disk stats (read/write):
  sda: ios=3225/1870, merge=1101/69307, ticks=76672/1761876, in_queue=1838860, util=99.07%
3.74user 1.09system 0:23.48elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2412minor)pagefaults 0swaps