fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [8.3% done] [  2126/ 27793 kb/s] [eta 00m:33s]
Threads: 3: [FFm] [9.1% done] [  1272/     0 kb/s] [eta 00m:40s]
Threads: 3: [FFm] [10.0% done] [  1216/     0 kb/s] [eta 00m:45s]
Threads: 3: [FFm] [54.5% done] [  1287/ 64638 kb/s] [eta 00m:05s]
Threads: 3: [FFF] [100.0% done] [     0/ 20038 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  4808/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [68.0% done] [ 24347/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 34118/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [76.0% done] [ 26635/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 29846/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [91.3% done] [ 35942/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 28675/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37852/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 32484/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=8785
  read : io=100MiB, bw=4,125KiB/s, runt= 25417msec
    slat (msec): min=  249, max=23383, avg=20589.64, stdev=3474.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=30188, per=73.56%, avg=9103.19, stdev=7621.27
  write: io=98,332KiB, bw=6,361KiB/s, runt= 15828msec
    slat (msec): min=    0, max=   11, avg= 1.79, stdev= 1.94
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112164, per=307.21%, avg=56082.00, stdev=79311.93
  cpu          : usr=4.61%, sys=1.57%, ctx=906
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=8786
  read : io=100MiB, bw=4,337KiB/s, runt= 24177msec
    slat (msec): min=  232, max=22048, avg=17737.44, stdev=3405.73
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=20189, per=84.18%, avg=10417.81, stdev=5537.18
  write: io=98,312KiB, bw=6,350KiB/s, runt= 15853msec
    slat (msec): min=    0, max=   15, avg= 1.95, stdev= 2.10
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=108458, per=297.06%, avg=54229.00, stdev=76691.39
  cpu          : usr=5.00%, sys=1.64%, ctx=987
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=8787
  read : io=100MiB, bw=4,242KiB/s, runt= 24717msec
    slat (msec): min=   83, max=18433, avg=13733.14, stdev=4380.13
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=17648, per=58.40%, avg=7227.43, stdev=5297.18
  write: io=85,980KiB, bw=5,564KiB/s, runt= 15821msec
    slat (msec): min=    0, max=   10, avg= 1.57, stdev= 1.75
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=117083, per=320.69%, avg=58541.50, stdev=82790.18
  cpu          : usr=5.02%, sys=1.23%, ctx=1101
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,376KiB/s, minb=4,125KiB/s, maxb=4,337KiB/s, mint=24177msec, maxt=25417msec
  WRITE: io=276MiB, aggrb=18,255KiB/s, minb=5,564KiB/s, maxb=6,361KiB/s, mint=24177msec, maxt=25417msec

Disk stats (read/write):
  sda: ios=3269/2135, merge=1229/68381, ticks=96040/1930512, in_queue=2041788, util=98.27%
3.66user 1.11system 0:25.82elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2425minor)pagefaults 0swaps