fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [7.9% done] [  3844/ 66588 kb/s] [eta 00m:35s]
Threads: 3: [mFF] [8.7% done] [  1140/     0 kb/s] [eta 00m:42s]
Threads: 3: [mFF] [45.5% done] [   788/ 54897 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [46.2% done] [   336/  1093 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [46.7% done] [   436/     0 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [47.1% done] [   876/     0 kb/s] [eta 00m:09s]
Threads: 3: [FFF] [100.0% done] [   304/ 30592 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [70.0% done] [  3183/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [68.2% done] [ 25764/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 23336/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [85.0% done] [ 31280/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [94.7% done] [ 31348/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 36596/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 36191/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30848/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32852/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=27971
  read : io=100MiB, bw=4,545KiB/s, runt= 23070msec
    slat (msec): min=  118, max=14262, avg=9539.72, stdev=3621.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=13585, per=47.42%, avg=6398.19, stdev=4867.98
  write: io=86,528KiB, bw=6,447KiB/s, runt= 13743msec
    slat (msec): min=    0, max=  810, avg= 2.63, stdev=29.19
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=43810, per=70.25%, avg=14612.67, stdev=25285.64
  cpu          : usr=4.92%, sys=1.72%, ctx=955
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=27972
  read : io=100MiB, bw=4,579KiB/s, runt= 22897msec
    slat (msec): min=   55, max=20367, avg=15443.04, stdev=4513.23
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    8, max=21875, per=68.93%, avg=9300.53, stdev=6270.00
  write: io=94,584KiB, bw=7,047KiB/s, runt= 13743msec
    slat (msec): min=    0, max=   58, avg= 2.01, stdev= 3.72
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=103795, per=171.03%, avg=35576.67, stdev=59097.03
  cpu          : usr=5.35%, sys=1.75%, ctx=899
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=27973
  read : io=100MiB, bw=4,497KiB/s, runt= 23314msec
    slat (msec): min=   99, max=21157, avg=16729.01, stdev=3964.98
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=15788, per=62.50%, avg=8432.37, stdev=5634.78
  write: io=98,080KiB, bw=7,310KiB/s, runt= 13739msec
    slat (msec): min=    0, max=  166, avg= 2.00, stdev= 6.63
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=87220, per=140.09%, avg=29141.33, stdev=50297.70
  cpu          : usr=5.25%, sys=1.61%, ctx=835
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,492KiB/s, minb=4,497KiB/s, maxb=4,579KiB/s, mint=22897msec, maxt=23314msec
  WRITE: io=273MiB, aggrb=20,802KiB/s, minb=6,447KiB/s, maxb=7,310KiB/s, mint=22897msec, maxt=23314msec

Disk stats (read/write):
  sda: ios=3310/1744, merge=1381/67925, ticks=82680/1620600, in_queue=1706824, util=99.18%
3.63user 1.21system 0:23.67elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2415minor)pagefaults 0swaps