fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [6.7% done] [  2846/ 16864 kb/s] [eta 00m:42s]
Threads: 3: [mmF] [30.8% done] [  1712/ 35588 kb/s] [eta 00m:09s]
Threads: 3: [mFF] [71.4% done] [   912/ 89380 kb/s] [eta 00m:02s]
Threads: 3: [FFF] [100.0% done] [     0/  5476 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  4348/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 25372/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.0% done] [ 34360/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [75.0% done] [ 25008/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [79.2% done] [ 33404/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [83.3% done] [ 28904/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [91.3% done] [ 36180/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 39104/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 32375/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=12355
  read : io=100MiB, bw=4,364KiB/s, runt= 24023msec
    slat (msec): min=  115, max=19006, avg=15831.03, stdev=4047.00
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=30638, per=62.11%, avg=8132.40, stdev=8650.39
  write: io=94,704KiB, bw=6,646KiB/s, runt= 14591msec
    slat (msec): min=    0, max=  164, avg= 2.00, stdev= 7.20
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=86022, per=143.89%, avg=28707.00, stdev=49636.27
  cpu          : usr=5.08%, sys=1.62%, ctx=952
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12356
  read : io=100MiB, bw=4,663KiB/s, runt= 22484msec
    slat (msec): min=   96, max=17875, avg=13151.16, stdev=3739.77
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=21534, per=69.69%, avg=9125.56, stdev=5874.03
  write: io=91,096KiB, bw=6,394KiB/s, runt= 14588msec
    slat (msec): min=    0, max=  221, avg= 2.79, stdev=15.60
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=69134, per=173.27%, avg=34567.00, stdev=48885.12
  cpu          : usr=5.09%, sys=1.64%, ctx=983
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12357
  read : io=100MiB, bw=4,470KiB/s, runt= 23455msec
    slat (msec): min=   96, max=21404, avg=17327.11, stdev=3718.86
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   18, max=21946, per=73.33%, avg=9602.31, stdev=6222.73
  write: io=98,488KiB, bw=6,911KiB/s, runt= 14592msec
    slat (msec): min=    0, max=   14, avg= 1.75, stdev= 2.03
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=33568, per=84.13%, avg=16784.00, stdev=23736.16
  cpu          : usr=5.24%, sys=1.47%, ctx=963
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,094KiB/s, minb=4,364KiB/s, maxb=4,663KiB/s, mint=22484msec, maxt=24023msec
  WRITE: io=278MiB, aggrb=19,950KiB/s, minb=6,394KiB/s, maxb=6,911KiB/s, mint=22484msec, maxt=24023msec

Disk stats (read/write):
  sda: ios=3282/1915, merge=1268/69086, ticks=107988/1665348, in_queue=1774292, util=99.01%
3.67user 1.10system 0:24.37elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2422minor)pagefaults 0swaps