fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [23.1% done] [  3009/ 43570 kb/s] [eta 00m:10s]
Threads: 3: [mFm] [23.5% done] [  1598/  9549 kb/s] [eta 00m:13s]
Threads: 3: [mFm] [23.8% done] [  1614/   267 kb/s] [eta 00m:16s]
Threads: 3: [mFm] [25.0% done] [  1823/   677 kb/s] [eta 00m:18s]
Threads: 3: [mFm] [25.9% done] [  1516/   606 kb/s] [eta 00m:20s]
Threads: 3: [mFm] [47.1% done] [  1431/ 40005 kb/s] [eta 00m:09s]
Threads: 3: [mFm] [64.3% done] [  2276/ 29243 kb/s] [eta 00m:05s]
Threads: 3: [FFm] [66.7% done] [   862/  2662 kb/s] [eta 00m:05s]
Threads: 3: [FFF] [100.0% done] [  1079/  2118 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.2% done] [ 12874/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [74.1% done] [ 30188/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [77.8% done] [ 30802/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [88.0% done] [ 31432/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [92.0% done] [ 32716/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 30731/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34259/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35502/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 31865/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=8378
  read : io=100MiB, bw=3,789KiB/s, runt= 27654msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1102, avg=81.77, stdev=172.07
    bw (KiB/s) : min=   18, max=15606, per=46.48%, avg=5285.94, stdev=5420.27
  write: io=92,808KiB, bw=5,286KiB/s, runt= 17976msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  667, avg= 6.56, stdev=48.84
    bw (KiB/s) : min=    0, max=42197, per=59.27%, avg=9717.80, stdev=18295.95
  cpu          : usr=3.08%, sys=1.35%, ctx=4909
  IO depths    : 1=6.7%, 2=52.6%, 4=29.5%, 8=11.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=45.6%, 4=0.5%, 10=15.7%, 20=19.4%, 50=6.3%, 100=0.6%
     lat (msec): 250=6.4%, 500=2.6%, 750=1.8%, 1000=0.7%, >=2000=0.1%
fio: (groupid=0): err= 0: pid=8379
  read : io=100MiB, bw=3,933KiB/s, runt= 26654msec
    clat (msec): min=    0, max=  585, avg=40.30, stdev=75.84
    bw (KiB/s) : min=   14, max=20818, per=100.08%, avg=11380.69, stdev=5186.90
  write: io=100MiB, bw=5,840KiB/s, runt= 17952msec
    slat (msec): min=    0, max=    7, avg= 0.00, stdev= 0.17
    clat (msec): min=    0, max=   20, avg= 0.30, stdev= 1.31
    bw (KiB/s) : min=    0, max=124559, per=379.87%, avg=62279.50, stdev=88076.51
  cpu          : usr=3.11%, sys=1.52%, ctx=4597
  IO depths    : 1=3.2%, 2=60.4%, 4=28.5%, 8=7.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=51.8%, 4=0.2%, 10=19.8%, 20=13.7%, 50=6.8%, 100=0.1%
     lat (msec): 250=6.8%, 500=0.4%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=8380
  read : io=100MiB, bw=3,822KiB/s, runt= 27430msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  838, avg=87.66, stdev=153.33
    bw (KiB/s) : min=    7, max=14311, per=42.50%, avg=4833.26, stdev=5281.73
  write: io=92,608KiB, bw=5,277KiB/s, runt= 17968msec
    slat (msec): min=    0, max=    1, avg= 0.00, stdev= 0.03
    clat (msec): min=    0, max=  706, avg=11.48, stdev=66.26
    bw (KiB/s) : min=    0, max=35973, per=46.29%, avg=7589.62, stdev=12639.54
  cpu          : usr=3.08%, sys=1.59%, ctx=4893
  IO depths    : 1=5.7%, 2=48.7%, 4=31.8%, 8=13.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=42.6%, 4=0.2%, 10=12.4%, 20=17.9%, 50=11.2%, 100=1.0%
     lat (msec): 250=8.5%, 500=3.5%, 750=2.3%, 1000=0.2%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,372KiB/s, minb=3,789KiB/s, maxb=3,933KiB/s, mint=26654msec, maxt=27654msec
  WRITE: io=281MiB, aggrb=16,395KiB/s, minb=5,277KiB/s, maxb=5,840KiB/s, mint=26654msec, maxt=27654msec

Disk stats (read/write):
  sda: ios=3308/2657, merge=1103/69223, ticks=115216/2159268, in_queue=2274732, util=98.33%
2.58user 1.27system 0:27.99elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2477minor)pagefaults 0swaps