fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [7.1% done] [     0/     0 kb/s] [eta 00m:39s]
Threads: 3: [Fmm] [7.0% done] [     0/     0 kb/s] [eta 00m:53s]
Threads: 3: [Fmm] [8.3% done] [   756/     0 kb/s] [eta 00m:55s]
Threads: 3: [Fmm] [18.8% done] [  1292/ 15916 kb/s] [eta 00m:26s]
Threads: 3: [Fmm] [35.0% done] [   556/ 38345 kb/s] [eta 00m:13s]
Threads: 3: [VFm] [44.4% done] [ 10176/ 48456 kb/s] [eta 00m:10s]
Threads: 3: [VFm] [45.0% done] [   728/     0 kb/s] [eta 00m:11s]
Threads: 3: [VFF] [76.9% done] [   340/ 34272 kb/s] [eta 00m:03s]
Threads: 3: [VFF] [73.3% done] [   860/     0 kb/s] [eta 00m:04s]
Threads: 3: [VFF] [75.0% done] [     0/     0 kb/s] [eta 00m:04s]
Threads: 3: [VFF] [76.5% done] [   560/     0 kb/s] [eta 00m:04s]
Threads: 3: [VFF] [77.8% done] [   460/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [68.2% done] [  8568/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 19112/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [77.3% done] [ 35800/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [81.8% done] [ 36364/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.5% done] [ 30216/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 36356/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34268/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33592/     0 kb/s] [eta 00m:00s]
Threads: 2: [EVV] [100.0% done] [ 31964/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=3587
  read : io=100MiB, bw=4,664KiB/s, runt= 22480msec
    slat (msec): min=  348, max=20728, avg=15992.18, stdev=3848.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=21400, per=60.89%, avg=8109.95, stdev=6310.20
  write: io=99MiB, bw=14,450KiB/s, runt=  7187msec
    slat (msec): min=    0, max=   22, avg= 2.20, stdev= 2.64
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111187, per=257.58%, avg=49864.00, stdev=56472.28
  cpu          : usr=5.66%, sys=1.80%, ctx=747
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=3588
  read : io=100MiB, bw=4,439KiB/s, runt= 23619msec
    slat (msec): min=   96, max=15987, avg=11650.01, stdev=3441.80
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   20, max=19178, per=65.94%, avg=8782.00, stdev=5778.78
  write: io=95,912KiB, bw=6,496KiB/s, runt= 15119msec
    slat (msec): min=    0, max=   22, avg= 2.23, stdev= 2.67
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max= 6782, per=17.52%, avg=3391.00, stdev=4795.60
  cpu          : usr=5.08%, sys=1.86%, ctx=906
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=3589
  read : io=100MiB, bw=4,457KiB/s, runt= 23524msec
    slat (msec): min=   54, max=13531, avg=9586.70, stdev=3417.40
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=16371, per=61.04%, avg=8129.79, stdev=5258.48
  write: io=88,496KiB, bw=6,028KiB/s, runt= 15031msec
    slat (msec): min=    0, max=   10, avg= 1.77, stdev= 1.88
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=14129, per=36.49%, avg=7064.50, stdev=9990.71
  cpu          : usr=5.12%, sys=1.43%, ctx=983
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,318KiB/s, minb=4,439KiB/s, maxb=4,664KiB/s, mint=22480msec, maxt=23619msec
  WRITE: io=279MiB, aggrb=19,359KiB/s, minb=6,028KiB/s, maxb=14,450KiB/s, mint=22480msec, maxt=23619msec

Disk stats (read/write):
  sda: ios=3335/2353, merge=1280/69035, ticks=106972/1607152, in_queue=1714584, util=96.87%
3.74user 1.24system 0:24.35elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2417minor)pagefaults 0swaps