fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [5.0% done] [     0/ 24783 kb/s] [eta 00m:57s]
Threads: 3: [mFm] [6.7% done] [   215/ 24238 kb/s] [eta 00m:56s]
Threads: 3: [mFF] [8.3% done] [     0/ 20922 kb/s] [eta 00m:55s]
Threads: 3: [mFF] [40.0% done] [   768/ 54950 kb/s] [eta 00m:09s]
Threads: 3: [mFF] [38.9% done] [     0/     0 kb/s] [eta 00m:11s]
Threads: 3: [mFF] [38.1% done] [     0/     0 kb/s] [eta 00m:13s]
Threads: 3: [mFF] [39.1% done] [     0/     0 kb/s] [eta 00m:14s]
Threads: 3: [mFF] [38.5% done] [     0/     0 kb/s] [eta 00m:16s]
Threads: 3: [mFF] [37.9% done] [     0/     0 kb/s] [eta 00m:18s]
Threads: 3: [mFF] [38.7% done] [   568/     0 kb/s] [eta 00m:19s]
Threads: 3: [FVV] [68.4% done] [  4937/ 44015 kb/s] [eta 00m:06s]
Threads: 3: [FVV] [73.7% done] [ 15518/     0 kb/s] [eta 00m:05s]
Threads: 3: [FVV] [78.9% done] [ 22284/     0 kb/s] [eta 00m:04s]
Threads: 3: [FVV] [84.2% done] [ 19968/     0 kb/s] [eta 00m:03s]
Threads: 3: [FVV] [89.5% done] [ 17798/     0 kb/s] [eta 00m:02s]
Threads: 3: [FVV] [90.0% done] [  4555/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [67.9% done] [ 31695/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [69.0% done] [ 31268/     0 kb/s] [eta 00m:09s]
Threads: 2: [V_V] [72.4% done] [ 36709/     0 kb/s] [eta 00m:08s]
Threads: 2: [V_V] [81.5% done] [ 29915/     0 kb/s] [eta 00m:05s]
Threads: 1: [V__] [100.0% done] [ 35283/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 36673/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=31763
  read : io=100MiB, bw=4,292KiB/s, runt= 24427msec
    slat (msec): min=  142, max=11613, avg=9999.86, stdev=1725.99
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   13, max=42214, per=96.65%, avg=12447.23, stdev=15809.05
  write: io=97,420KiB, bw=5,427KiB/s, runt= 18380msec
    slat (msec): min=    0, max=   13, avg= 1.92, stdev= 2.01
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max= 7598, per=23.03%, avg=3799.00, stdev=5372.60
  cpu          : usr=5.04%, sys=1.67%, ctx=808
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=31764
  read : io=100MiB, bw=5,023KiB/s, runt= 20875msec
    slat (msec): min=   82, max=18765, avg=15135.03, stdev=3073.45
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   17, max=21886, per=76.86%, avg=9898.53, stdev=6687.54
  write: io=98MiB, bw=8,281KiB/s, runt= 12441msec
    slat (msec): min=    0, max=   15, avg= 2.05, stdev= 2.13
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=32517, per=98.55%, avg=16258.50, stdev=22992.99
  cpu          : usr=6.00%, sys=1.88%, ctx=793
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=31765
  read : io=100MiB, bw=4,694KiB/s, runt= 22337msec
    slat (msec): min=  110, max=18249, avg=14558.66, stdev=3363.24
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   15, max=19812, per=76.10%, avg=9800.00, stdev=6322.65
  write: io=98,084KiB, bw=8,075KiB/s, runt= 12437msec
    slat (msec): min=    0, max= 2533, avg= 5.03, stdev=88.86
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=18192, per=55.14%, avg=9096.00, stdev=12863.69
  cpu          : usr=5.61%, sys=1.72%, ctx=824
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,878KiB/s, minb=4,292KiB/s, maxb=5,023KiB/s, mint=20875msec, maxt=24427msec
  WRITE: io=289MiB, aggrb=16,497KiB/s, minb=5,427KiB/s, maxb=8,281KiB/s, mint=20875msec, maxt=24427msec

Disk stats (read/write):
  sda: ios=3053/2639, merge=1247/71179, ticks=73576/2171644, in_queue=2256804, util=97.83%
3.79user 1.26system 0:24.97elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2429minor)pagefaults 0swaps