fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [75.0% done] [  1376/ 64620 kb/s] [eta 00m:01s]
Threads: 3: [mFF] [66.7% done] [    16/   144 kb/s] [eta 00m:02s]
Threads: 3: [mFF] [71.4% done] [   216/     0 kb/s] [eta 00m:02s]
Threads: 3: [FFF] [100.0% done] [   200/  2824 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [ 15559/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 28708/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.0% done] [ 32124/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.0% done] [ 28288/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.0% done] [ 35884/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 38092/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35580/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 29040/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34424/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=20602
  read : io=100MiB, bw=4,420KiB/s, runt= 23723msec
    slat (msec): min=   22, max=18323, avg=13716.26, stdev=3797.79
    clat (msec): min=    0, max=    3, avg= 0.01, stdev= 0.13
    bw (KiB/s) : min=    9, max=16812, per=57.21%, avg=7538.78, stdev=5784.04
  write: io=94,992KiB, bw=6,847KiB/s, runt= 14205msec
    slat (msec): min=    0, max=  471, avg= 3.99, stdev=27.05
    clat (msec): min=    0, max=    3, avg= 0.01, stdev= 0.17
    bw (KiB/s) : min=    0, max=71027, per=124.56%, avg=26301.40, stdev=36005.52
  cpu          : usr=5.87%, sys=1.58%, ctx=856
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.6%, 4=0.3%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=20603
  read : io=100MiB, bw=4,474KiB/s, runt= 23436msec
    slat (msec): min=   66, max=21447, avg=16942.13, stdev=4207.49
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=21123, per=71.47%, avg=9418.12, stdev=6038.51
  write: io=97,528KiB, bw=7,071KiB/s, runt= 14123msec
    slat (msec): min=    0, max=   11, avg= 1.86, stdev= 2.06
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=53492, per=126.66%, avg=26746.00, stdev=37824.56
  cpu          : usr=5.26%, sys=1.83%, ctx=856
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=20604
  read : io=100MiB, bw=4,392KiB/s, runt= 23871msec
    slat (msec): min=   32, max=22131, avg=17358.81, stdev=3951.86
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=19394, per=67.78%, avg=8931.67, stdev=6862.34
  write: io=98MiB, bw=7,245KiB/s, runt= 14213msec
    slat (msec): min=    0, max=   36, avg= 2.37, stdev= 2.61
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112538, per=213.07%, avg=44991.50, stdev=54994.90
  cpu          : usr=6.00%, sys=1.86%, ctx=844
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,178KiB/s, minb=4,392KiB/s, maxb=4,474KiB/s, mint=23436msec, maxt=23871msec
  WRITE: io=286MiB, aggrb=21,116KiB/s, minb=6,847KiB/s, maxb=7,245KiB/s, mint=23436msec, maxt=23871msec

Disk stats (read/write):
  sda: ios=3093/2258, merge=1567/70813, ticks=73628/1790432, in_queue=1866300, util=97.26%
4.08user 1.29system 0:24.16elapsed 22%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps