fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [42.9% done] [  1425/ 87633 kb/s] [eta 00m:04s]
Threads: 3: [FmF] [44.4% done] [   296/     0 kb/s] [eta 00m:05s]
Threads: 3: [FmF] [45.5% done] [   492/     0 kb/s] [eta 00m:06s]
Threads: 3: [FmF] [42.9% done] [   724/     0 kb/s] [eta 00m:08s]
Threads: 3: [FFF] [100.0% done] [   484/ 36844 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.4% done] [     0/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [70.0% done] [ 18196/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [75.0% done] [ 32764/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [80.0% done] [ 30604/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [89.5% done] [ 28652/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [94.7% done] [ 36960/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 37268/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32739/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33976/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 30212/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=17883
  read : io=100MiB, bw=4,630KiB/s, runt= 22647msec
    slat (msec): min=  113, max=19965, avg=15727.27, stdev=3689.34
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=22213, per=66.00%, avg=9164.47, stdev=5747.66
  write: io=94,520KiB, bw=7,435KiB/s, runt= 13017msec
    slat (msec): min=    0, max=   12, avg= 1.71, stdev= 1.89
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=113057, per=248.18%, avg=56528.50, stdev=79943.37
  cpu          : usr=5.21%, sys=1.61%, ctx=813
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17884
  read : io=100MiB, bw=4,792KiB/s, runt= 21878msec
    slat (msec): min=   13, max=15270, avg=10571.40, stdev=3846.12
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=19961, per=54.11%, avg=7513.61, stdev=6180.25
  write: io=92,628KiB, bw=7,308KiB/s, runt= 12978msec
    slat (msec): min=    0, max=   18, avg= 1.87, stdev= 2.18
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111792, per=163.82%, avg=37314.00, stdev=64499.88
  cpu          : usr=5.32%, sys=2.03%, ctx=928
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17885
  read : io=100MiB, bw=4,628KiB/s, runt= 22653msec
    slat (msec): min=12595, max=21726, avg=17343.29, stdev=2458.24
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   18, max=23313, per=77.52%, avg=10764.25, stdev=5496.57
  write: io=100MiB, bw=8,056KiB/s, runt= 13015msec
    slat (msec): min=    0, max=   13, avg= 1.85, stdev= 1.92
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112276, per=246.47%, avg=56138.00, stdev=79391.12
  cpu          : usr=5.49%, sys=1.48%, ctx=760
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,886KiB/s, minb=4,628KiB/s, maxb=4,792KiB/s, mint=21878msec, maxt=22653msec
  WRITE: io=283MiB, aggrb=22,777KiB/s, minb=7,308KiB/s, maxb=8,056KiB/s, mint=21878msec, maxt=22653msec

Disk stats (read/write):
  sda: ios=3129/1887, merge=1235/70464, ticks=81848/1637816, in_queue=1719668, util=98.96%
3.66user 1.17system 0:22.94elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2428minor)pagefaults 0swaps