fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [30.0% done] [ 11276/ 56248 kb/s] [eta 00m:07s]
Threads: 3: [mmm] [44.4% done] [  6910/ 56875 kb/s] [eta 00m:05s]
Threads: 3: [mFF] [45.5% done] [  6144/     0 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [   936/ 34356 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [67.9% done] [  9900/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [71.4% done] [ 25120/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [75.0% done] [ 25496/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [81.5% done] [ 26104/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [92.0% done] [ 33344/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 29980/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34788/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 29360/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 25032/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=16658
  read : io=100MiB, bw=3,685KiB/s, runt= 28452msec
    slat (msec): min=   20, max=22504, avg=16531.53, stdev=6263.01
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=17414, per=62.05%, avg=6860.28, stdev=5216.35
  write: io=89,020KiB, bw=4,904KiB/s, runt= 18588msec
    slat (msec): min=    0, max=   25, avg= 1.92, stdev= 2.55
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=108935, per=247.24%, avg=36364.67, stdev=62847.80
  cpu          : usr=4.06%, sys=1.35%, ctx=946
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16659
  read : io=100MiB, bw=3,705KiB/s, runt= 28297msec
    slat (msec): min=    0, max=24172, avg=16069.14, stdev=7901.41
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=17051, per=66.94%, avg=7401.27, stdev=5281.94
  write: io=88,716KiB, bw=4,887KiB/s, runt= 18588msec
    slat (msec): min=    0, max=  102, avg= 3.04, stdev= 6.79
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=55480, per=127.21%, avg=18710.33, stdev=31845.13
  cpu          : usr=4.96%, sys=1.37%, ctx=1083
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16660
  read : io=100MiB, bw=3,702KiB/s, runt= 28322msec
    slat (msec): min=    0, max=23384, avg=16044.22, stdev=6830.69
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   13, max=19631, per=65.81%, avg=7276.29, stdev=6004.21
  write: io=89,256KiB, bw=4,917KiB/s, runt= 18588msec
    slat (msec): min=    0, max=  416, avg= 2.96, stdev=12.29
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=63780, per=207.49%, avg=30517.00, stdev=35106.91
  cpu          : usr=4.77%, sys=1.47%, ctx=1038
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,056KiB/s, minb=3,685KiB/s, maxb=3,705KiB/s, mint=28297msec, maxt=28452msec
  WRITE: io=261MiB, aggrb=14,708KiB/s, minb=4,887KiB/s, maxb=4,917KiB/s, mint=28297msec, maxt=28452msec

Disk stats (read/write):
  sda: ios=3708/3023, merge=1598/63565, ticks=91976/2188284, in_queue=2280708, util=97.74%
3.95user 1.22system 0:28.70elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2433minor)pagefaults 0swaps