fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [ 10231/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [71.4% done] [ 20577/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 33381/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [85.0% done] [ 36250/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [90.0% done] [ 34874/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 38505/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37355/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33601/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37034/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=2352
  read : io=100MiB, bw=4,672KiB/s, runt= 22440msec
    slat (msec): min=    0, max=21095, avg=15861.61, stdev=4214.64
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=15279, per=71.95%, avg=10014.18, stdev=4624.48
  write: io=99MiB, bw=7,764KiB/s, runt= 13312msec
    slat (msec): min=    0, max=   17, avg= 2.29, stdev= 2.46
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=104292, per=229.51%, avg=52146.00, stdev=73745.58
  cpu          : usr=5.88%, sys=1.85%, ctx=861
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2353
  read : io=100MiB, bw=4,704KiB/s, runt= 22287msec
    slat (msec): min=   66, max=20828, avg=16480.22, stdev=3546.66
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   19, max=13399, per=76.46%, avg=10642.50, stdev=3157.44
  write: io=96,876KiB, bw=7,458KiB/s, runt= 13300msec
    slat (msec): min=    0, max=   15, avg= 2.13, stdev= 2.19
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=103271, per=227.26%, avg=51635.50, stdev=73023.62
  cpu          : usr=5.73%, sys=2.14%, ctx=844
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2354
  read : io=100MiB, bw=4,639KiB/s, runt= 22600msec
    slat (msec): min=   47, max=20810, avg=16707.91, stdev=4085.56
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=15047, per=67.55%, avg=9402.88, stdev=4891.91
  write: io=97,568KiB, bw=7,514KiB/s, runt= 13296msec
    slat (msec): min=    0, max=   16, avg= 2.08, stdev= 2.22
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=38183, per=84.03%, avg=19091.50, stdev=26999.46
  cpu          : usr=5.63%, sys=1.75%, ctx=904
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,919KiB/s, minb=4,639KiB/s, maxb=4,704KiB/s, mint=22287msec, maxt=22600msec
  WRITE: io=288MiB, aggrb=22,721KiB/s, minb=7,458KiB/s, maxb=7,764KiB/s, mint=22287msec, maxt=22600msec

Disk stats (read/write):
  sda: ios=3150/2195, merge=1739/71501, ticks=69728/1661820, in_queue=1734124, util=98.61%
3.93user 1.36system 0:22.90elapsed 23%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2419minor)pagefaults 0swaps