fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [50.0% done] [  1212/ 51268 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [     0/ 33112 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [70.0% done] [  5852/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [71.4% done] [ 27084/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [76.2% done] [ 31636/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [81.0% done] [ 26332/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.0% done] [ 35664/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 36139/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32064/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 39204/     0 kb/s] [eta 00m:00s]
Threads: 2: [VEV] [100.0% done] [ 33804/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5136
  read : io=100MiB, bw=4,564KiB/s, runt= 22974msec
    slat (msec): min=   65, max=21538, avg=17948.52, stdev=3237.95
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=19269, per=70.96%, avg=9675.75, stdev=5834.98
  write: io=98MiB, bw=7,591KiB/s, runt= 13536msec
    slat (msec): min=    0, max=   69, avg= 2.00, stdev= 3.80
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    1, max=97928, per=165.46%, avg=36424.67, stdev=53564.60
  cpu          : usr=5.47%, sys=1.69%, ctx=847
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5137
  read : io=100MiB, bw=4,693KiB/s, runt= 22339msec
    slat (msec): min=   58, max=19125, avg=14346.41, stdev=3995.47
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    2, max=15158, per=64.63%, avg=8811.63, stdev=5254.20
  write: io=97,232KiB, bw=7,362KiB/s, runt= 13524msec
    slat (msec): min=    0, max=  221, avg= 3.05, stdev=15.79
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=83971, per=127.22%, avg=28006.67, stdev=48466.54
  cpu          : usr=5.78%, sys=1.75%, ctx=979
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5138
  read : io=100MiB, bw=4,545KiB/s, runt= 23070msec
    slat (msec): min=   64, max=20181, avg=15289.42, stdev=4232.44
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   19, max=15256, per=62.68%, avg=8546.78, stdev=4533.38
  write: io=94,184KiB, bw=7,106KiB/s, runt= 13571msec
    slat (msec): min=    0, max=  227, avg= 3.01, stdev=15.93
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=68815, per=154.90%, avg=34099.33, stdev=34411.64
  cpu          : usr=5.79%, sys=1.44%, ctx=1033
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,635KiB/s, minb=4,545KiB/s, maxb=4,693KiB/s, mint=22339msec, maxt=23070msec
  WRITE: io=285MiB, aggrb=22,014KiB/s, minb=7,106KiB/s, maxb=7,591KiB/s, mint=22339msec, maxt=23070msec

Disk stats (read/write):
  sda: ios=3147/1767, merge=1517/71175, ticks=88280/1545560, in_queue=1633844, util=98.80%
3.93user 1.12system 0:23.40elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2415minor)pagefaults 0swaps