fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [9.7% done] [ 10748/ 33364 kb/s] [eta 00m:28s]
Threads: 3: [mFF] [9.5% done] [     0/ 35204 kb/s] [eta 00m:38s]
Threads: 3: [mFF] [38.5% done] [  1956/ 38396 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [42.9% done] [   996/  8628 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [43.8% done] [  1188/     0 kb/s] [eta 00m:09s]
Threads: 3: [mFF] [53.3% done] [  1580/  9816 kb/s] [eta 00m:07s]
Threads: 3: [FFF] [100.0% done] [     0/ 25332 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [     0/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 17092/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 28484/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [78.3% done] [ 29056/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [82.6% done] [ 23740/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.9% done] [ 35260/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 33088/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33120/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 26512/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 32715/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=1290
  read : io=100MiB, bw=4,226KiB/s, runt= 24811msec
    slat (msec): min=  109, max=16527, avg=11453.62, stdev=4470.39
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=17784, per=51.75%, avg=6561.35, stdev=5057.27
  write: io=82,140KiB, bw=5,562KiB/s, runt= 15122msec
    slat (msec): min=    0, max=  354, avg= 2.17, stdev=11.17
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=56850, per=104.03%, avg=18956.33, stdev=32816.88
  cpu          : usr=4.79%, sys=1.45%, ctx=1063
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1291
  read : io=100MiB, bw=4,308KiB/s, runt= 24335msec
    slat (msec): min=   66, max=22135, avg=17313.59, stdev=4617.56
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   17, max=24512, per=74.96%, avg=9503.88, stdev=6281.14
  write: io=95,432KiB, bw=6,463KiB/s, runt= 15118msec
    slat (msec): min=    0, max=   64, avg= 2.00, stdev= 4.13
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=51805, per=142.15%, avg=25902.50, stdev=36631.67
  cpu          : usr=5.00%, sys=1.45%, ctx=894
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1292
  read : io=100MiB, bw=4,249KiB/s, runt= 24673msec
    slat (msec): min=   86, max=21428, avg=16085.27, stdev=4808.00
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   18, max=18810, per=69.21%, avg=8774.05, stdev=5941.94
  write: io=91,532KiB, bw=6,201KiB/s, runt= 15114msec
    slat (msec): min=    0, max=   91, avg= 2.30, stdev= 7.37
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=97123, per=178.71%, avg=32563.67, stdev=55910.74
  cpu          : usr=4.96%, sys=1.17%, ctx=988
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,678KiB/s, minb=4,226KiB/s, maxb=4,308KiB/s, mint=24335msec, maxt=24811msec
  WRITE: io=263MiB, aggrb=18,222KiB/s, minb=5,562KiB/s, maxb=6,463KiB/s, mint=24335msec, maxt=24811msec

Disk stats (read/write):
  sda: ios=3565/2033, merge=1382/65125, ticks=83544/1837140, in_queue=1921840, util=99.22%
3.68user 1.01system 0:25.03elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2419minor)pagefaults 0swaps