fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [8.1% done] [     0/     0 kb/s] [eta 00m:34s]
Threads: 3: [mFF] [8.0% done] [     0/     0 kb/s] [eta 00m:46s]
Threads: 3: [mFF] [8.3% done] [     0/     0 kb/s] [eta 00m:55s]
Threads: 3: [mFF] [10.0% done] [     0/     0 kb/s] [eta 00m:54s]
Threads: 3: [mFF] [11.7% done] [     0/     0 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [13.3% done] [   944/     0 kb/s] [eta 00m:52s]
Threads: 3: [mFF] [15.0% done] [     0/     0 kb/s] [eta 00m:51s]
Threads: 3: [mFF] [16.7% done] [     0/     0 kb/s] [eta 00m:50s]
Threads: 3: [mFF] [18.3% done] [     0/     0 kb/s] [eta 00m:49s]
Threads: 3: [mVV] [20.0% done] [  9716/     0 kb/s] [eta 00m:48s]
Threads: 3: [mVV] [25.5% done] [ 32264/ 24068 kb/s] [eta 00m:38s]
Threads: 3: [mVV] [45.2% done] [ 31228/ 28544 kb/s] [eta 00m:17s]
Threads: 3: [mVV] [45.5% done] [ 37336/   128 kb/s] [eta 00m:18s]
Threads: 3: [mVV] [44.4% done] [ 34424/     0 kb/s] [eta 00m:20s]
Threads: 3: [mVV] [45.9% done] [ 25965/     0 kb/s] [eta 00m:20s]
Threads: 3: [mVV] [45.0% done] [ 23701/     0 kb/s] [eta 00m:22s]
Threads: 1: [m__] [45.2% done] [  9589/     0 kb/s] [eta 00m:23s]
Threads: 1: [F__] [100.0% done] [   646/ 33564 kb/s] [eta 00m:00s]
Threads: 1: [F__] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [F__] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [74.2% done] [  9098/     0 kb/s] [eta 00m:08s]
Threads: 1: [V__] [96.0% done] [ 33064/     0 kb/s] [eta 00m:01s]
Threads: 1: [V__] [100.0% done] [ 35502/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=9561
  read : io=100MiB, bw=4,089KiB/s, runt= 25639msec
    slat (msec): min=   62, max= 5598, avg=4028.16, stdev=1237.71
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    1, max=39757, per=105.08%, avg=12892.79, stdev=15859.57
  write: io=85,780KiB, bw=3,834KiB/s, runt= 22906msec
    slat (msec): min=    0, max= 1207, avg= 3.25, stdev=43.65
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=31702, per=82.53%, avg=10576.67, stdev=18295.08
  cpu          : usr=4.82%, sys=1.36%, ctx=1035
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=9562
  read : io=100MiB, bw=5,670KiB/s, runt= 18493msec
    slat (msec): min=  184, max=17035, avg=13436.90, stdev=2277.92
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   23, max=21111, per=108.39%, avg=13298.07, stdev=7230.29
  write: io=98MiB, bw=9,078KiB/s, runt= 11345msec
    slat (msec): min=    0, max=   15, avg= 1.97, stdev= 2.27
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=107749, per=420.37%, avg=53874.50, stdev=76190.05
  cpu          : usr=6.88%, sys=2.03%, ctx=851
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=9563
  read : io=100MiB, bw=5,589KiB/s, runt= 18759msec
    slat (msec): min=  244, max=17240, avg=13801.89, stdev=2239.14
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   13, max=22276, per=107.70%, avg=13213.36, stdev=8106.30
  write: io=98MiB, bw=9,058KiB/s, runt= 11340msec
    slat (msec): min=    0, max=   13, avg= 1.95, stdev= 2.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=108250, per=422.32%, avg=54125.00, stdev=76544.31
  cpu          : usr=7.01%, sys=1.71%, ctx=895
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,269KiB/s, minb=4,089KiB/s, maxb=5,670KiB/s, mint=18493msec, maxt=25639msec
  WRITE: io=280MiB, aggrb=12,816KiB/s, minb=3,834KiB/s, maxb=9,078KiB/s, mint=18493msec, maxt=25639msec

Disk stats (read/write):
  sda: ios=3203/3208, merge=1246/68361, ticks=88816/2130496, in_queue=2219696, util=97.66%
3.89user 1.10system 0:25.98elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2430minor)pagefaults 0swaps