fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [42.9% done] [   933/ 13129 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [   272/ 41136 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [71.4% done] [   772/     0 kb/s] [eta 00m:04s]
Threads: 3: [FFV] [73.3% done] [  5832/     0 kb/s] [eta 00m:04s]
Threads: 3: [FFV] [85.7% done] [ 18956/     0 kb/s] [eta 00m:02s]
Threads: 3: [FFV] [100.0% done] [ 16296/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [100.0% done] [ 23458/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [100.0% done] [ 14580/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [100.0% done] [ 12632/     0 kb/s] [eta 00m:00s]
Threads: 2: [FF_] [100.0% done] [  7412/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [72.0% done] [ 21296/     0 kb/s] [eta 00m:07s]
Threads: 2: [VV_] [79.2% done] [ 27668/     0 kb/s] [eta 00m:05s]
Threads: 2: [VV_] [90.9% done] [ 34296/     0 kb/s] [eta 00m:02s]
Threads: 2: [VV_] [100.0% done] [ 34928/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [100.0% done] [ 31819/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 35324/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=25214
  read : io=100MiB, bw=4,451KiB/s, runt= 23557msec
    slat (msec): min=   41, max=19889, avg=16213.57, stdev=4149.50
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=34114, per=86.64%, avg=11569.50, stdev=10642.39
  write: io=93,800KiB, bw=5,513KiB/s, runt= 17421msec
    slat (msec): min=    0, max=   79, avg= 1.87, stdev= 2.82
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=94873, per=185.98%, avg=31625.33, stdev=54774.09
  cpu          : usr=5.23%, sys=1.44%, ctx=925
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25215
  read : io=100MiB, bw=4,479KiB/s, runt= 23407msec
    slat (msec): min=   83, max=21349, avg=18176.97, stdev=3848.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    2, max=26359, per=102.36%, avg=13668.62, stdev=8748.41
  write: io=95,588KiB, bw=5,633KiB/s, runt= 17376msec
    slat (msec): min=    0, max=   17, avg= 1.97, stdev= 2.40
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=103825, per=305.28%, avg=51912.50, stdev=73415.36
  cpu          : usr=5.37%, sys=1.69%, ctx=920
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25216
  read : io=100MiB, bw=6,147KiB/s, runt= 17056msec
    slat (msec): min=  171, max=15368, avg=11886.32, stdev=2197.61
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   16, max=30732, per=96.59%, avg=12897.21, stdev=9064.72
  write: io=99,916KiB, bw=10,659KiB/s, runt=  9598msec
    slat (msec): min=    0, max=   15, avg= 2.12, stdev= 2.27
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=105582, per=310.44%, avg=52791.00, stdev=74657.75
  cpu          : usr=7.29%, sys=2.65%, ctx=812
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,353KiB/s, minb=4,451KiB/s, maxb=6,147KiB/s, mint=17056msec, maxt=23557msec
  WRITE: io=283MiB, aggrb=17,005KiB/s, minb=5,513KiB/s, maxb=10,659KiB/s, mint=17056msec, maxt=23557msec

Disk stats (read/write):
  sda: ios=3121/2009, merge=1283/70113, ticks=59668/2142556, in_queue=2279552, util=98.68%
3.78user 1.23system 0:23.87elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2423minor)pagefaults 0swaps