fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [25.0% done] [  3000/  1505 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [26.7% done] [  2760/     0 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [38.5% done] [  4639/ 53370 kb/s] [eta 00m:08s]
Threads: 3: [mmF] [37.5% done] [  2276/  9235 kb/s] [eta 00m:10s]
Threads: 3: [mFF] [46.7% done] [  1047/ 55260 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [50.0% done] [   748/  4718 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [60.0% done] [   539/ 11653 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [66.7% done] [  3194/  8341 kb/s] [eta 00m:05s]
Threads: 3: [FFF] [100.0% done] [  2851/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [67.9% done] [     0/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [67.7% done] [ 15052/     0 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [73.3% done] [ 21685/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [82.1% done] [ 31744/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [88.9% done] [ 28624/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [96.2% done] [ 32968/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35725/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32472/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30503/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 27994/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=16494
  read : io=100MiB, bw=3,671KiB/s, runt= 28482msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  863, avg=84.97, stdev=147.24
    bw (KiB/s) : min=   10, max=16048, per=47.55%, avg=5046.83, stdev=4878.67
  write: io=82,404KiB, bw=4,266KiB/s, runt= 19780msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  693, avg= 8.72, stdev=59.61
    bw (KiB/s) : min=    0, max=14807, per=55.04%, avg=7857.60, stdev=7298.32
  cpu          : usr=2.08%, sys=1.19%, ctx=5402
  IO depths    : 1=1.9%, 2=49.4%, 4=31.8%, 8=16.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=42.6%, 4=0.2%, 10=11.9%, 20=12.1%, 50=15.2%, 100=3.8%
     lat (msec): 250=7.5%, 500=3.9%, 750=2.1%, 1000=0.4%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16495
  read : io=100MiB, bw=3,538KiB/s, runt= 29603msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1078, avg=68.07, stdev=131.24
    bw (KiB/s) : min=    5, max=25047, per=58.25%, avg=6182.28, stdev=5952.28
  write: io=96,488KiB, bw=4,996KiB/s, runt= 19776msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  994, avg= 5.30, stdev=51.70
    bw (KiB/s) : min=    0, max=17257, per=49.42%, avg=7055.67, stdev=9048.34
  cpu          : usr=2.89%, sys=1.23%, ctx=5606
  IO depths    : 1=4.8%, 2=54.1%, 4=29.9%, 8=11.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=46.5%, 4=0.5%, 10=12.9%, 20=21.9%, 50=6.4%, 100=0.8%
     lat (msec): 250=6.2%, 500=2.7%, 750=1.6%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16496
  read : io=100MiB, bw=3,570KiB/s, runt= 29361msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1080, avg=65.62, stdev=145.50
    bw (KiB/s) : min=    7, max=16704, per=64.53%, avg=6848.73, stdev=6130.63
  write: io=96,880KiB, bw=5,017KiB/s, runt= 19772msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  539, avg= 2.27, stdev=24.22
    bw (KiB/s) : min=    0, max= 7068, per=24.75%, avg=3534.00, stdev=4997.83
  cpu          : usr=2.90%, sys=1.25%, ctx=5789
  IO depths    : 1=5.8%, 2=54.1%, 4=30.1%, 8=10.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=47.5%, 4=0.5%, 10=15.4%, 20=19.9%, 50=6.4%, 100=0.6%
     lat (msec): 250=6.3%, 500=1.4%, 750=1.3%, 1000=0.3%, >=2000=0.2%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=10,613KiB/s, minb=3,538KiB/s, maxb=3,671KiB/s, mint=28482msec, maxt=29603msec
  WRITE: io=269MiB, aggrb=14,276KiB/s, minb=4,266KiB/s, maxb=5,017KiB/s, mint=28482msec, maxt=29603msec

Disk stats (read/write):
  sda: ios=3704/2758, merge=1352/66041, ticks=126224/2609372, in_queue=2740688, util=98.79%
2.34user 1.14system 0:29.97elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2487minor)pagefaults 0swaps