fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [50.0% done] [  1008/ 56500 kb/s] [eta 00m:03s]
Threads: 3: [FFm] [50.0% done] [  1316/    96 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [50.0% done] [  1372/  2268 kb/s] [eta 00m:05s]
Threads: 3: [FFF] [100.0% done] [     0/ 29644 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [ 23264/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [71.4% done] [ 20876/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [76.2% done] [ 28792/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.0% done] [ 34216/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [90.0% done] [ 31815/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.0% done] [ 32932/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 37544/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37876/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 30056/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=12721
  read : io=100MiB, bw=4,665KiB/s, runt= 22474msec
    slat (msec): min=   72, max=20867, avg=17150.84, stdev=3243.34
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=18536, per=68.83%, avg=9508.62, stdev=5876.54
  write: io=98MiB, bw=7,672KiB/s, runt= 13383msec
    slat (msec): min=    0, max=   74, avg= 2.30, stdev= 4.25
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=93778, per=147.94%, avg=31454.00, stdev=53974.96
  cpu          : usr=5.75%, sys=1.66%, ctx=800
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12722
  read : io=100MiB, bw=4,898KiB/s, runt= 21405msec
    slat (msec): min=  111, max=19819, avg=15319.61, stdev=3315.03
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=29550, per=78.87%, avg=10895.94, stdev=7648.95
  write: io=98MiB, bw=7,763KiB/s, runt= 13217msec
    slat (msec): min=    0, max=   13, avg= 1.97, stdev= 2.10
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=47627, per=112.00%, avg=23813.50, stdev=33677.37
  cpu          : usr=5.89%, sys=1.72%, ctx=811
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12723
  read : io=100MiB, bw=4,605KiB/s, runt= 22769msec
    slat (msec): min=   57, max=17521, avg=13095.14, stdev=4469.70
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=24805, per=54.44%, avg=7521.38, stdev=5897.29
  write: io=88,508KiB, bw=6,512KiB/s, runt= 13917msec
    slat (msec): min=    0, max=  280, avg= 1.82, stdev= 7.32
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=74802, per=117.33%, avg=24947.67, stdev=43175.12
  cpu          : usr=5.27%, sys=1.69%, ctx=1061
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,815KiB/s, minb=4,605KiB/s, maxb=4,898KiB/s, mint=21405msec, maxt=22769msec
  WRITE: io=282MiB, aggrb=21,262KiB/s, minb=6,512KiB/s, maxb=7,763KiB/s, mint=21405msec, maxt=22769msec

Disk stats (read/write):
  sda: ios=3278/1740, merge=1238/70434, ticks=77776/1665120, in_queue=1743244, util=98.73%
3.79user 1.14system 0:23.07elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2404minor)pagefaults 0swaps