fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [8.3% done] [  1491/ 27924 kb/s] [eta 00m:33s]
Threads: 3: [mmF] [9.5% done] [  2653/     0 kb/s] [eta 00m:38s]
Threads: 3: [mmF] [10.4% done] [  2251/     0 kb/s] [eta 00m:43s]
Threads: 3: [mmF] [26.1% done] [  3705/ 21142 kb/s] [eta 00m:17s]
Threads: 3: [mmF] [43.8% done] [   309/ 23860 kb/s] [eta 00m:09s]
Threads: 3: [mmF] [57.1% done] [   873/ 24031 kb/s] [eta 00m:06s]
Threads: 3: [mmF] [60.0% done] [  1605/     0 kb/s] [eta 00m:06s]
Threads: 3: [mmF] [58.8% done] [  3831/     0 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [57.9% done] [  3616/  5302 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [60.0% done] [    36/     0 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [59.1% done] [   251/     0 kb/s] [eta 00m:09s]
Threads: 3: [mFF] [58.3% done] [    56/     0 kb/s] [eta 00m:10s]
Threads: 3: [mFF] [60.0% done] [    20/     0 kb/s] [eta 00m:10s]
Threads: 3: [mFF] [59.3% done] [   113/   109 kb/s] [eta 00m:11s]
Threads: 3: [mFF] [60.7% done] [  1149/    89 kb/s] [eta 00m:11s]
Threads: 3: [FFF] [100.0% done] [   134/ 12027 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [67.9% done] [  8635/     0 kb/s] [eta 00m:09s]
Threads: 3: [FVV] [74.1% done] [ 21853/     0 kb/s] [eta 00m:07s]
Threads: 3: [FVV] [84.0% done] [ 27127/     0 kb/s] [eta 00m:04s]
Threads: 3: [FVV] [91.7% done] [ 18167/     0 kb/s] [eta 00m:02s]
Threads: 3: [FVV] [100.0% done] [ 30076/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [72.7% done] [ 32964/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [75.8% done] [ 23808/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [81.2% done] [ 30308/     0 kb/s] [eta 00m:06s]
Threads: 1: [V__] [90.0% done] [ 31420/     0 kb/s] [eta 00m:03s]
Threads: 1: [V__] [100.0% done] [ 34120/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=15664
  read : io=100MiB, bw=3,642KiB/s, runt= 28790msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 3548, avg=99.05, stdev=280.60
    bw (KiB/s) : min=    0, max=34466, per=45.09%, avg=4926.26, stdev=9071.47
  write: io=80,484KiB, bw=3,506KiB/s, runt= 23504msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 3039, avg=15.66, stdev=161.23
    bw (KiB/s) : min=    0, max=38639, per=52.13%, avg=6125.29, stdev=14368.81
  cpu          : usr=2.03%, sys=1.42%, ctx=8708
  IO depths    : 1=1.3%, 2=50.2%, 4=30.4%, 8=18.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=45.3%, 4=0.1%, 10=17.5%, 20=15.4%, 50=9.2%, 100=2.2%
     lat (msec): 250=4.1%, 500=3.0%, 750=1.6%, 1000=0.4%, >=2000=0.7%
fio: (groupid=0): err= 0: pid=15665
  read : io=100MiB, bw=3,901KiB/s, runt= 26878msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 2115, avg=85.40, stdev=164.06
    bw (KiB/s) : min=   29, max=16115, per=50.18%, avg=5482.41, stdev=5334.70
  write: io=88,812KiB, bw=4,995KiB/s, runt= 18204msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1091, avg= 4.72, stdev=58.48
    bw (KiB/s) : min=    0, max=23952, per=62.09%, avg=7295.50, stdev=11353.54
  cpu          : usr=2.74%, sys=1.52%, ctx=8545
  IO depths    : 1=0.8%, 2=45.9%, 4=30.1%, 8=23.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=42.1%, 4=2.0%, 10=11.6%, 20=18.7%, 50=9.8%, 100=0.5%
     lat (msec): 250=9.5%, 500=4.2%, 750=0.9%, 1000=0.2%, >=2000=0.3%
fio: (groupid=0): err= 0: pid=15666
  read : io=100MiB, bw=3,862KiB/s, runt= 27147msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  559, avg=44.81, stdev=84.72
    bw (KiB/s) : min=    5, max=20578, per=88.04%, avg=9619.17, stdev=6169.46
  write: io=98MiB, bw=5,648KiB/s, runt= 18204msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  191, avg= 0.67, stdev= 8.24
    bw (KiB/s) : min=    0, max=53268, per=226.67%, avg=26634.00, stdev=37666.16
  cpu          : usr=2.90%, sys=1.31%, ctx=8536
  IO depths    : 1=1.2%, 2=54.5%, 4=31.1%, 8=13.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=50.4%, 4=1.1%, 10=18.8%, 20=18.2%, 50=2.9%, 100=0.2%
     lat (msec): 250=6.6%, 500=1.5%, 750=0.2%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=10,926KiB/s, minb=3,642KiB/s, maxb=3,901KiB/s, mint=26878msec, maxt=28790msec
  WRITE: io=263MiB, aggrb=11,750KiB/s, minb=3,506KiB/s, maxb=5,648KiB/s, mint=26878msec, maxt=28790msec

Disk stats (read/write):
  sda: ios=3835/3321, merge=1131/63992, ticks=110864/2835064, in_queue=2946180, util=98.87%
2.17user 1.23system 0:29.17elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2480minor)pagefaults 0swaps