fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [16.7% done] [  9876/  8816 kb/s] [eta 00m:15s]
Threads: 3: [mmF] [50.0% done] [  2172/ 84820 kb/s] [eta 00m:04s]
Threads: 3: [mFF] [50.0% done] [   924/   396 kb/s] [eta 00m:05s]
Threads: 3: [mFF] [50.0% done] [   220/     0 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [50.0% done] [   280/     0 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [50.0% done] [   356/     0 kb/s] [eta 00m:08s]
Threads: 3: [FFF] [100.0% done] [   672/ 26440 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [     0/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 20460/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 29284/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.8% done] [ 28320/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.5% done] [ 30072/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 35620/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33916/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 31000/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34276/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [100.0% done] [ 31456/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=17118
  read : io=100MiB, bw=4,335KiB/s, runt= 24186msec
    slat (msec): min=   80, max=15639, avg=10235.03, stdev=4295.68
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=17561, per=50.71%, avg=6523.89, stdev=5419.14
  write: io=82,564KiB, bw=5,642KiB/s, runt= 14985msec
    slat (msec): min=    0, max=   13, avg= 1.61, stdev= 1.85
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=10509, per=27.96%, avg=5254.50, stdev=7430.99
  cpu          : usr=4.76%, sys=1.70%, ctx=998
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17119
  read : io=100MiB, bw=4,355KiB/s, runt= 24075msec
    slat (msec): min=   56, max=20105, avg=14922.37, stdev=5045.14
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   15, max=17116, per=64.90%, avg=8349.76, stdev=5794.53
  write: io=92,428KiB, bw=6,316KiB/s, runt= 14985msec
    slat (msec): min=    0, max=   65, avg= 1.99, stdev= 4.12
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=99410, per=176.51%, avg=33167.00, stdev=57368.14
  cpu          : usr=4.77%, sys=1.69%, ctx=932
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17120
  read : io=100MiB, bw=4,288KiB/s, runt= 24450msec
    slat (msec): min=   72, max=23015, avg=18932.64, stdev=3670.74
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=19043, per=72.48%, avg=9324.81, stdev=5883.09
  write: io=99,984KiB, bw=6,834KiB/s, runt= 14981msec
    slat (msec): min=    0, max=  112, avg= 2.04, stdev= 5.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=95223, per=196.99%, avg=37015.00, stdev=51026.58
  cpu          : usr=4.97%, sys=1.57%, ctx=817
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,865KiB/s, minb=4,288KiB/s, maxb=4,355KiB/s, mint=24075msec, maxt=24450msec
  WRITE: io=269MiB, aggrb=18,790KiB/s, minb=5,642KiB/s, maxb=6,834KiB/s, mint=24075msec, maxt=24450msec

Disk stats (read/write):
  sda: ios=3431/2014, merge=1415/66625, ticks=81796/1843896, in_queue=1932092, util=98.96%
3.56user 1.22system 0:24.76elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2424minor)pagefaults 0swaps