fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [37.5% done] [  8284/ 82260 kb/s] [eta 00m:05s]
Threads: 3: [mFm] [44.4% done] [  6564/ 15112 kb/s] [eta 00m:05s]
Threads: 3: [mFF] [45.5% done] [  2078/ 29945 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [54.5% done] [  1428/  8552 kb/s] [eta 00m:05s]
Threads: 3: [FFF] [100.0% done] [     0/ 23460 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [     0/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 22540/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [70.8% done] [ 26776/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [78.3% done] [ 27112/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [86.4% done] [ 28632/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [90.9% done] [ 34232/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 35220/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 29889/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 24657/     0 kb/s] [eta 00m:00s]
Threads: 1: [VE_] [100.0% done] [ 36242/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=992
  read : io=100MiB, bw=4,271KiB/s, runt= 24551msec
    slat (msec): min=   43, max=18346, avg=13126.28, stdev=5317.08
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=21815, per=56.00%, avg=7175.22, stdev=6145.38
  write: io=87,616KiB, bw=6,016KiB/s, runt= 14913msec
    slat (msec): min=    0, max=   48, avg= 1.99, stdev= 3.48
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=105016, per=189.81%, avg=35037.67, stdev=60603.03
  cpu          : usr=4.87%, sys=1.40%, ctx=1061
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=993
  read : io=100MiB, bw=4,299KiB/s, runt= 24389msec
    slat (msec): min=  101, max=21705, avg=16887.53, stdev=4936.73
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=19183, per=68.98%, avg=8838.95, stdev=6087.87
  write: io=95,828KiB, bw=6,580KiB/s, runt= 14913msec
    slat (msec): min=    0, max=  114, avg= 2.06, stdev= 5.32
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=92087, per=166.46%, avg=30727.67, stdev=53138.76
  cpu          : usr=5.20%, sys=1.41%, ctx=927
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=994
  read : io=100MiB, bw=4,385KiB/s, runt= 23912msec
    slat (msec): min=   68, max=19528, avg=13493.13, stdev=5097.27
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   18, max=20610, per=65.23%, avg=8358.36, stdev=5633.13
  write: io=85,396KiB, bw=5,865KiB/s, runt= 14909msec
    slat (msec): min=    0, max=  192, avg= 2.71, stdev=13.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=82606, per=150.11%, avg=27709.00, stdev=47542.91
  cpu          : usr=4.83%, sys=1.51%, ctx=1089
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,813KiB/s, minb=4,271KiB/s, maxb=4,385KiB/s, mint=23912msec, maxt=24551msec
  WRITE: io=263MiB, aggrb=18,459KiB/s, minb=5,865KiB/s, maxb=6,580KiB/s, mint=23912msec, maxt=24551msec

Disk stats (read/write):
  sda: ios=3626/1899, merge=1439/65309, ticks=74192/1759796, in_queue=1833992, util=98.80%
3.67user 1.07system 0:24.84elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2416minor)pagefaults 0swaps