fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [7.7% done] [  2864/ 59908 kb/s] [eta 00m:36s]
Threads: 3: [FmF] [8.3% done] [   920/  8984 kb/s] [eta 00m:44s]
Threads: 3: [FmF] [29.4% done] [   972/ 29988 kb/s] [eta 00m:12s]
Threads: 3: [FmF] [30.0% done] [   844/     0 kb/s] [eta 00m:14s]
Threads: 3: [FmF] [30.4% done] [  1236/     0 kb/s] [eta 00m:16s]
Threads: 3: [FmF] [66.7% done] [   852/ 51828 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [     0/  3964 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVF] [66.7% done] [     0/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [68.0% done] [ 13868/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 28820/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [79.2% done] [ 29568/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.0% done] [ 25976/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.5% done] [ 36528/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 33560/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30084/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 36992/     0 kb/s] [eta 00m:00s]
Threads: 2: [VEV] [100.0% done] [ 33164/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=12323
  read : io=100MiB, bw=4,062KiB/s, runt= 25812msec
    slat (msec): min=  174, max=22809, avg=18678.40, stdev=3955.15
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=14268, per=69.59%, avg=8480.47, stdev=4929.00
  write: io=96,168KiB, bw=6,080KiB/s, runt= 16195msec
    slat (msec): min=    0, max=   11, avg= 1.78, stdev= 1.89
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=49697, per=140.06%, avg=24848.50, stdev=35141.09
  cpu          : usr=4.76%, sys=1.36%, ctx=983
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12324
  read : io=100MiB, bw=4,121KiB/s, runt= 25444msec
    slat (msec): min=   48, max=17357, avg=11668.78, stdev=4456.92
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=14846, per=51.21%, avg=6241.00, stdev=4867.76
  write: io=85,780KiB, bw=5,422KiB/s, runt= 16199msec
    slat (msec): min=    0, max=  329, avg= 4.10, stdev=26.76
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=51599, per=97.33%, avg=17268.00, stdev=29731.69
  cpu          : usr=4.68%, sys=1.26%, ctx=1101
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12325
  read : io=100MiB, bw=4,072KiB/s, runt= 25748msec
    slat (msec): min=   92, max=23689, avg=19409.73, stdev=3893.78
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=14903, per=76.75%, avg=9353.62, stdev=5373.86
  write: io=99,272KiB, bw=6,262KiB/s, runt= 16231msec
    slat (msec): min=    0, max=   97, avg= 1.98, stdev= 5.42
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=96049, per=181.35%, avg=32173.67, stdev=55318.16
  cpu          : usr=4.92%, sys=1.58%, ctx=1014
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,187KiB/s, minb=4,062KiB/s, maxb=4,121KiB/s, mint=25444msec, maxt=25812msec
  WRITE: io=275MiB, aggrb=17,741KiB/s, minb=5,422KiB/s, maxb=6,262KiB/s, mint=25444msec, maxt=25812msec

Disk stats (read/write):
  sda: ios=3323/2062, merge=1425/68134, ticks=113932/1992676, in_queue=2108868, util=99.02%
3.71user 1.10system 0:26.14elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2425minor)pagefaults 0swaps