fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [8.6% done] [  3123/   791 kb/s] [eta 00m:32s]
Threads: 3: [mmF] [9.8% done] [  3123/     0 kb/s] [eta 00m:37s]
Threads: 3: [mmF] [11.6% done] [  2619/  1303 kb/s] [eta 00m:38s]
Threads: 3: [mmF] [12.2% done] [  1441/ 14324 kb/s] [eta 00m:43s]
Threads: 3: [mmF] [13.0% done] [  2213/     0 kb/s] [eta 00m:47s]
Threads: 3: [mmF] [19.5% done] [  1382/  9594 kb/s] [eta 00m:33s]
Threads: 3: [FmF] [20.0% done] [  2177/ 15978 kb/s] [eta 00m:36s]
Threads: 3: [FmF] [20.0% done] [    90/     0 kb/s] [eta 00m:40s]
Threads: 3: [FmF] [20.4% done] [    43/     0 kb/s] [eta 00m:43s]
Threads: 3: [FmF] [20.3% done] [    39/     0 kb/s] [eta 00m:47s]
Threads: 3: [VmV] [21.7% done] [  1181/    55 kb/s] [eta 00m:47s]
Threads: 3: [VmV] [23.3% done] [ 13827/   775 kb/s] [eta 00m:46s]
Threads: 3: [VmV] [25.0% done] [ 32598/     0 kb/s] [eta 00m:45s]
Threads: 3: [VmV] [26.7% done] [ 29440/   346 kb/s] [eta 00m:44s]
Threads: 3: [VmV] [28.3% done] [ 37025/     0 kb/s] [eta 00m:43s]
Threads: 3: [VmV] [30.0% done] [ 33441/   606 kb/s] [eta 00m:42s]
Threads: 3: [VmV] [31.7% done] [ 33016/     0 kb/s] [eta 00m:41s]
Threads: 1: [_m_] [45.7% done] [ 19794/ 29475 kb/s] [eta 00m:25s]
Threads: 1: [_m_] [53.7% done] [ 10243/     0 kb/s] [eta 00m:19s]
Threads: 1: [_F_] [100.0% done] [   791/ 20759 kb/s] [eta 00m:00s]
Threads: 1: [_F_] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [_V_] [71.4% done] [  4336/     0 kb/s] [eta 00m:10s]
Threads: 1: [_V_] [86.7% done] [ 23047/     0 kb/s] [eta 00m:04s]
Threads: 1: [_V_] [100.0% done] [ 23028/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=29461
  read : io=100MiB, bw=5,215KiB/s, runt= 20106msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1091, avg=64.65, stdev=134.88
    bw (KiB/s) : min=    0, max=21251, per=60.92%, avg=6955.75, stdev=7746.20
  write: io=93,492KiB, bw=7,070KiB/s, runt= 13540msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  919, avg= 5.87, stdev=57.44
    bw (KiB/s) : min=    0, max=12724, per=38.46%, avg=4139.80, stdev=5615.67
  cpu          : usr=3.70%, sys=1.91%, ctx=4805
  IO depths    : 1=2.9%, 2=54.9%, 4=28.6%, 8=13.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.2%, 4=0.4%, 10=14.8%, 20=16.2%, 50=6.8%, 100=1.8%
     lat (msec): 250=8.1%, 500=2.1%, 750=1.0%, 1000=0.3%, >=2000=0.2%
fio: (groupid=0): err= 0: pid=29462
  read : io=100MiB, bw=3,806KiB/s, runt= 27550msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 3858, avg=99.34, stdev=314.13
    bw (KiB/s) : min=    8, max=26859, per=40.37%, avg=4608.88, stdev=7772.09
  write: io=63,848KiB, bw=2,646KiB/s, runt= 24708msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 2775, avg=27.86, stdev=175.00
    bw (KiB/s) : min=    0, max=17072, per=21.06%, avg=2266.56, stdev=5576.11
  cpu          : usr=2.18%, sys=1.03%, ctx=5957
  IO depths    : 1=0.8%, 2=42.8%, 4=31.6%, 8=24.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=39.2%, 4=1.2%, 10=8.3%, 20=21.0%, 50=17.4%, 100=4.9%
     lat (msec): 250=1.9%, 500=1.8%, 750=1.4%, 1000=0.8%, >=2000=1.6%
fio: (groupid=0): err= 0: pid=29463
  read : io=100MiB, bw=5,126KiB/s, runt= 20450msec
    clat (msec): min=    0, max=  633, avg=32.00, stdev=59.78
    bw (KiB/s) : min=    8, max=24567, per=120.00%, avg=13700.85, stdev=7214.96
  write: io=100MiB, bw=7,735KiB/s, runt= 13556msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   12, avg= 0.27, stdev= 0.74
    bw (KiB/s) : min=    0, max=111605, per=518.42%, avg=55802.50, stdev=78916.65
  cpu          : usr=4.58%, sys=1.70%, ctx=4767
  IO depths    : 1=3.2%, 2=60.0%, 4=28.7%, 8=8.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=50.1%, 4=1.5%, 10=19.6%, 20=15.3%, 50=5.7%, 100=1.4%
     lat (msec): 250=5.6%, 500=0.5%, 750=0.1%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,417KiB/s, minb=3,806KiB/s, maxb=5,215KiB/s, mint=20106msec, maxt=27550msec
  WRITE: io=254MiB, aggrb=10,764KiB/s, minb=2,646KiB/s, maxb=7,735KiB/s, mint=20106msec, maxt=27550msec

Disk stats (read/write):
  sda: ios=3826/2727, merge=1133/62093, ticks=88432/2013480, in_queue=2104352, util=97.60%
2.34user 1.07system 0:28.02elapsed 12%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2472minor)pagefaults 0swaps