fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [42.9% done] [  1588/     0 kb/s] [eta 00m:04s]
Threads: 3: [FmF] [40.0% done] [  2172/     0 kb/s] [eta 00m:06s]
Threads: 3: [FmF] [71.4% done] [  1188/ 37340 kb/s] [eta 00m:02s]
Threads: 3: [FFF] [100.0% done] [     0/  2762 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [69.2% done] [   724/     0 kb/s] [eta 00m:04s]
Threads: 3: [VFF] [76.9% done] [ 12156/     0 kb/s] [eta 00m:03s]
Threads: 3: [VFF] [84.6% done] [ 10536/     0 kb/s] [eta 00m:02s]
Threads: 3: [VFV] [70.6% done] [ 18356/     0 kb/s] [eta 00m:05s]
Threads: 3: [VFV] [72.2% done] [ 24740/     0 kb/s] [eta 00m:05s]
Threads: 3: [VFV] [82.4% done] [ 26048/     0 kb/s] [eta 00m:03s]
Threads: 3: [VFV] [88.2% done] [ 27120/     0 kb/s] [eta 00m:02s]
Threads: 3: [VFV] [100.0% done] [ 23352/     0 kb/s] [eta 00m:00s]
Threads: 2: [_FV] [100.0% done] [ 15340/     0 kb/s] [eta 00m:00s]
Threads: 2: [_FV] [100.0% done] [  7052/     0 kb/s] [eta 00m:00s]
Threads: 2: [_FV] [100.0% done] [ 10392/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [71.4% done] [ 24024/     0 kb/s] [eta 00m:08s]
Threads: 1: [_V_] [91.3% done] [ 36220/     0 kb/s] [eta 00m:02s]
Threads: 1: [_V_] [100.0% done] [ 32160/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=24241
  read : io=100MiB, bw=6,341KiB/s, runt= 16536msec
    slat (msec): min= 8006, max=15561, avg=12030.09, stdev=2081.64
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=21143, per=95.10%, avg=12979.93, stdev=5673.58
  write: io=100MiB, bw=11,989KiB/s, runt=  8746msec
    slat (msec): min=    0, max=   19, avg= 2.29, stdev= 2.43
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=108259, per=354.13%, avg=54129.50, stdev=76550.67
  cpu          : usr=7.76%, sys=2.39%, ctx=752
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=24242
  read : io=100MiB, bw=4,549KiB/s, runt= 23048msec
    slat (msec): min=    4, max=18060, avg=15517.95, stdev=4390.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   17, max=37922, per=103.97%, avg=14189.50, stdev=15558.05
  write: io=93,328KiB, bw=4,873KiB/s, runt= 19609msec
    slat (msec): min=    0, max=   16, avg= 1.89, stdev= 2.16
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=11751, per=38.44%, avg=5875.50, stdev=8309.21
  cpu          : usr=5.36%, sys=1.51%, ctx=971
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=24243
  read : io=100MiB, bw=5,077KiB/s, runt= 20653msec
    slat (msec): min=   52, max=19264, avg=15176.06, stdev=3408.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    2, max=26157, per=77.39%, avg=10562.53, stdev=5741.69
  write: io=96,980KiB, bw=8,665KiB/s, runt= 11460msec
    slat (msec): min=    0, max=   16, avg= 1.89, stdev= 2.18
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=110217, per=360.54%, avg=55108.50, stdev=77935.19
  cpu          : usr=6.12%, sys=2.09%, ctx=880
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,648KiB/s, minb=4,549KiB/s, maxb=6,341KiB/s, mint=16536msec, maxt=23048msec
  WRITE: io=286MiB, aggrb=15,285KiB/s, minb=4,873KiB/s, maxb=11,989KiB/s, mint=16536msec, maxt=23048msec

Disk stats (read/write):
  sda: ios=3175/1725, merge=1147/71451, ticks=62080/2601504, in_queue=2667868, util=98.14%
3.84user 1.19system 0:23.32elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2414minor)pagefaults 0swaps