fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [   168/ 17984 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  2120/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [71.4% done] [ 23704/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [76.2% done] [ 32036/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [81.0% done] [ 29468/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.0% done] [ 33984/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 39204/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 39000/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34516/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32992/     0 kb/s] [eta 00m:00s]
Threads: 1: [EEV] [100.0% done] [ 35664/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=2908
  read : io=100MiB, bw=4,528KiB/s, runt= 23153msec
    slat (msec): min=13130, max=21992, avg=18418.82, stdev=2323.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=28210, per=84.48%, avg=11348.19, stdev=7786.19
  write: io=100MiB, bw=7,584KiB/s, runt= 13825msec
    slat (msec): min=    0, max=   19, avg= 2.41, stdev= 3.25
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=110829, per=259.17%, avg=58130.00, stdev=55613.74
  cpu          : usr=6.18%, sys=1.78%, ctx=732
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2909
  read : io=100MiB, bw=4,582KiB/s, runt= 22883msec
    slat (msec): min=   59, max=20523, avg=16086.86, stdev=3516.85
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=20239, per=68.82%, avg=9244.95, stdev=6613.60
  write: io=99MiB, bw=7,511KiB/s, runt= 13821msec
    slat (msec): min=    0, max=   60, avg= 2.61, stdev= 3.64
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=99248, per=180.23%, avg=40424.75, stdev=49009.07
  cpu          : usr=6.24%, sys=1.85%, ctx=840
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2910
  read : io=100MiB, bw=4,477KiB/s, runt= 23417msec
    slat (msec): min=   48, max=21896, avg=17331.48, stdev=3670.70
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=20672, per=65.09%, avg=8743.78, stdev=5639.74
  write: io=99,036KiB, bw=7,339KiB/s, runt= 13817msec
    slat (msec): min=    0, max=   10, avg= 1.86, stdev= 1.97
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=50185, per=111.88%, avg=25092.50, stdev=35486.15
  cpu          : usr=5.09%, sys=1.74%, ctx=846
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,433KiB/s, minb=4,477KiB/s, maxb=4,582KiB/s, mint=22883msec, maxt=23417msec
  WRITE: io=296MiB, aggrb=22,429KiB/s, minb=7,339KiB/s, maxb=7,584KiB/s, mint=22883msec, maxt=23417msec

Disk stats (read/write):
  sda: ios=2937/2382, merge=1143/73079, ticks=77784/1824232, in_queue=1911464, util=96.62%
4.10user 1.30system 0:23.75elapsed 22%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps