fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [42.9% done] [  7728/ 44512 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [44.4% done] [  1768/ 43080 kb/s] [eta 00m:05s]
Threads: 3: [FFF] [100.0% done] [   240/ 35268 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [     0/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [68.0% done] [ 19460/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 33200/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 24892/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 28040/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.5% done] [ 35888/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.7% done] [ 28392/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 39228/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 35044/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5132
  read : io=100MiB, bw=4,122KiB/s, runt= 25438msec
    slat (msec): min=   52, max=22621, avg=18956.86, stdev=4632.37
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=20667, per=61.77%, avg=7638.95, stdev=5727.42
  write: io=95,416KiB, bw=6,121KiB/s, runt= 15961msec
    slat (msec): min=    0, max=   58, avg= 2.20, stdev= 4.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=94812, per=177.19%, avg=31765.00, stdev=54600.84
  cpu          : usr=4.80%, sys=1.26%, ctx=929
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5133
  read : io=100MiB, bw=4,312KiB/s, runt= 24315msec
    slat (msec): min=   68, max=20628, avg=15711.75, stdev=4689.02
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=16565, per=69.92%, avg=8646.83, stdev=5268.16
  write: io=93,520KiB, bw=5,988KiB/s, runt= 15992msec
    slat (msec): min=    0, max=   71, avg= 2.12, stdev= 4.52
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=93330, per=173.74%, avg=31146.67, stdev=53852.37
  cpu          : usr=4.95%, sys=1.37%, ctx=1055
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5134
  read : io=100MiB, bw=4,187KiB/s, runt= 25039msec
    slat (msec): min=   46, max=20098, avg=14813.22, stdev=5426.76
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   15, max=13928, per=60.02%, avg=7422.64, stdev=4914.49
  write: io=91,040KiB, bw=5,843KiB/s, runt= 15953msec
    slat (msec): min=    0, max=  127, avg= 2.75, stdev=10.61
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=97202, per=180.88%, avg=32427.00, stdev=56096.81
  cpu          : usr=4.76%, sys=1.53%, ctx=1231
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,366KiB/s, minb=4,122KiB/s, maxb=4,312KiB/s, mint=24315msec, maxt=25438msec
  WRITE: io=273MiB, aggrb=17,927KiB/s, minb=5,843KiB/s, maxb=6,121KiB/s, mint=24315msec, maxt=25438msec

Disk stats (read/write):
  sda: ios=3432/2132, merge=1377/67698, ticks=103200/1815112, in_queue=1923736, util=98.92%
3.67user 1.04system 0:25.75elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2426minor)pagefaults 0swaps