fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [8.1% done] [ 11396/ 54776 kb/s] [eta 00m:34s]
Threads: 3: [mFm] [33.3% done] [  7828/ 73196 kb/s] [eta 00m:08s]
Threads: 3: [mFm] [50.0% done] [  4292/ 32940 kb/s] [eta 00m:05s]
Threads: 3: [mFF] [60.0% done] [  3728/ 27120 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [   248/ 16300 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [71.4% done] [  2592/     0 kb/s] [eta 00m:06s]
Threads: 3: [FVF] [76.2% done] [  7760/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [68.0% done] [ 17988/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 18168/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [76.0% done] [ 24252/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 24932/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.0% done] [ 29180/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [91.7% done] [ 27112/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 33372/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 33008/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 24364/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=32578
  read : io=100MiB, bw=4,039KiB/s, runt= 25957msec
    slat (msec): min=   43, max=19632, avg=14492.27, stdev=5905.56
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=18641, per=58.97%, avg=7146.52, stdev=5024.40
  write: io=83,372KiB, bw=5,066KiB/s, runt= 16852msec
    slat (msec): min=    0, max=  208, avg= 3.66, stdev=19.31
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=48936, per=143.81%, avg=22566.50, stdev=26093.42
  cpu          : usr=4.70%, sys=1.25%, ctx=1090
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=32579
  read : io=100MiB, bw=4,306KiB/s, runt= 24348msec
    slat (msec): min=   22, max=20631, avg=14970.52, stdev=5409.67
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=27600, per=65.78%, avg=7971.04, stdev=6113.83
  write: io=92,992KiB, bw=6,616KiB/s, runt= 14391msec
    slat (msec): min=    0, max=   24, avg= 1.99, stdev= 2.38
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=107698, per=229.03%, avg=35938.67, stdev=62145.43
  cpu          : usr=4.83%, sys=1.43%, ctx=1017
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=32580
  read : io=100MiB, bw=4,142KiB/s, runt= 25311msec
    slat (msec): min=   43, max=19624, avg=13763.65, stdev=6256.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=15600, per=62.51%, avg=7574.75, stdev=4461.96
  write: io=81,896KiB, bw=4,977KiB/s, runt= 16848msec
    slat (msec): min=    0, max=   10, avg= 1.87, stdev= 2.06
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=18405, per=58.64%, avg=9202.50, stdev=13014.30
  cpu          : usr=4.42%, sys=1.60%, ctx=1148
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,118KiB/s, minb=4,039KiB/s, maxb=4,306KiB/s, mint=24348msec, maxt=25957msec
  WRITE: io=252MiB, aggrb=15,692KiB/s, minb=4,977KiB/s, maxb=6,616KiB/s, mint=24348msec, maxt=25957msec

Disk stats (read/write):
  sda: ios=3909/1963, merge=1308/62550, ticks=89644/1651416, in_queue=1741056, util=98.99%
3.57user 1.14system 0:26.31elapsed 17%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2419minor)pagefaults 0swaps