fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [   848/ 51288 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  4936/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 27557/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.0% done] [ 35808/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [75.0% done] [ 25013/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [82.6% done] [ 33024/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [87.0% done] [ 34009/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.5% done] [ 31610/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 39083/     0 kb/s] [eta 00m:00s]
Threads: 2: [VEV] [100.0% done] [ 35138/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=14694
  read : io=100MiB, bw=4,325KiB/s, runt= 24240msec
    slat (msec): min=   54, max=22759, avg=19755.56, stdev=3847.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=34163, per=87.46%, avg=11349.21, stdev=9290.15
  write: io=98,848KiB, bw=6,921KiB/s, runt= 14624msec
    slat (msec): min=    0, max=   85, avg= 1.86, stdev= 3.47
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=97978, per=157.83%, avg=32832.33, stdev=56418.40
  cpu          : usr=5.13%, sys=1.60%, ctx=897
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14695
  read : io=100MiB, bw=4,530KiB/s, runt= 23144msec
    slat (msec): min=  140, max=21654, avg=17180.34, stdev=3181.24
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    2, max=19599, per=89.69%, avg=11639.60, stdev=5458.89
  write: io=99,576KiB, bw=6,980KiB/s, runt= 14608msec
    slat (msec): min=    0, max=   19, avg= 1.95, stdev= 2.49
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=96337, per=231.56%, avg=48168.50, stdev=68120.55
  cpu          : usr=5.53%, sys=1.47%, ctx=895
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14696
  read : io=100MiB, bw=4,435KiB/s, runt= 23641msec
    slat (msec): min=  140, max=21244, avg=16998.99, stdev=3388.67
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   19, max=20658, per=68.46%, avg=8884.19, stdev=6055.24
  write: io=98,668KiB, bw=6,916KiB/s, runt= 14608msec
    slat (msec): min=    0, max=  160, avg= 2.43, stdev= 8.97
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=74600, per=120.35%, avg=25035.33, stdev=42925.01
  cpu          : usr=5.58%, sys=1.39%, ctx=935
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,977KiB/s, minb=4,325KiB/s, maxb=4,530KiB/s, mint=23144msec, maxt=24240msec
  WRITE: io=290MiB, aggrb=20,802KiB/s, minb=6,916KiB/s, maxb=6,980KiB/s, mint=23144msec, maxt=24240msec

Disk stats (read/write):
  sda: ios=3028/2063, merge=1398/72182, ticks=94336/1875796, in_queue=1970132, util=98.92%
3.89user 1.12system 0:24.64elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2420minor)pagefaults 0swaps