fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [37.5% done] [  3196/101672 kb/s] [eta 00m:05s]
Threads: 3: [FmF] [44.4% done] [  1492/ 58440 kb/s] [eta 00m:05s]
Threads: 3: [FmF] [62.5% done] [   928/ 17936 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [     0/ 15306 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [     0/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.2% done] [ 18608/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 33804/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [77.3% done] [ 23196/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.7% done] [ 29292/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [90.5% done] [ 35328/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 35456/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35776/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 24548/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [100.0% done] [ 35348/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5322
  read : io=100MiB, bw=4,441KiB/s, runt= 23611msec
    slat (msec): min=  111, max=20012, avg=15926.61, stdev=4016.27
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=16831, per=60.04%, avg=7998.70, stdev=5766.34
  write: io=93,472KiB, bw=6,823KiB/s, runt= 14028msec
    slat (msec): min=    0, max=  148, avg= 2.49, stdev= 9.82
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=76672, per=126.40%, avg=25790.33, stdev=44066.20
  cpu          : usr=5.30%, sys=1.81%, ctx=922
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5323
  read : io=100MiB, bw=4,467KiB/s, runt= 23471msec
    slat (msec): min=   66, max=18364, avg=13288.23, stdev=4505.96
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=16036, per=57.89%, avg=7712.61, stdev=5606.18
  write: io=89,628KiB, bw=6,551KiB/s, runt= 14008msec
    slat (msec): min=    0, max=   70, avg= 1.77, stdev= 3.88
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=102914, per=168.46%, avg=34370.00, stdev=59360.93
  cpu          : usr=5.11%, sys=1.48%, ctx=980
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5324
  read : io=100MiB, bw=4,533KiB/s, runt= 23128msec
    slat (msec): min=    8, max=21074, avg=16044.84, stdev=3997.87
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   15, max=20128, per=70.88%, avg=9443.56, stdev=6076.31
  write: io=96,412KiB, bw=7,056KiB/s, runt= 13991msec
    slat (msec): min=    0, max=   13, avg= 1.99, stdev= 1.95
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=53199, per=130.37%, avg=26599.50, stdev=37617.37
  cpu          : usr=5.53%, sys=1.54%, ctx=872
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,323KiB/s, minb=4,441KiB/s, maxb=4,533KiB/s, mint=23128msec, maxt=23611msec
  WRITE: io=273MiB, aggrb=20,403KiB/s, minb=6,551KiB/s, maxb=7,056KiB/s, mint=23128msec, maxt=23611msec

Disk stats (read/write):
  sda: ios=3324/2102, merge=1379/67653, ticks=79260/1667512, in_queue=1746772, util=98.94%
3.80user 1.14system 0:23.84elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2415minor)pagefaults 0swaps