fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [5.0% done] [  2227/129689 kb/s] [eta 00m:57s]
Threads: 3: [FFm] [6.7% done] [  1532/  8212 kb/s] [eta 00m:56s]
Threads: 3: [FFm] [8.3% done] [  1420/     0 kb/s] [eta 00m:55s]
Threads: 3: [FFm] [10.0% done] [  1088/     0 kb/s] [eta 00m:54s]
Threads: 3: [FFm] [11.7% done] [  1036/   936 kb/s] [eta 00m:53s]
Threads: 3: [FFm] [13.3% done] [  1148/     0 kb/s] [eta 00m:52s]
Threads: 3: [FFm] [15.0% done] [  1388/     0 kb/s] [eta 00m:51s]
Threads: 3: [FFm] [38.5% done] [   952/ 39836 kb/s] [eta 00m:16s]
Threads: 3: [FFm] [39.3% done] [  1480/     0 kb/s] [eta 00m:17s]
Threads: 3: [FFm] [48.0% done] [   840/ 12716 kb/s] [eta 00m:13s]
Threads: 3: [FVm] [48.1% done] [   864/   260 kb/s] [eta 00m:14s]
Threads: 3: [FVm] [48.3% done] [ 16780/     0 kb/s] [eta 00m:15s]
Threads: 3: [FVm] [48.4% done] [ 15704/     0 kb/s] [eta 00m:16s]
Threads: 3: [FVm] [57.1% done] [ 19872/ 10908 kb/s] [eta 00m:12s]
Threads: 3: [FVm] [56.7% done] [ 21228/     0 kb/s] [eta 00m:13s]
Threads: 3: [FVm] [56.2% done] [ 11364/   132 kb/s] [eta 00m:14s]
Threads: 2: [F_m] [57.6% done] [ 13896/     0 kb/s] [eta 00m:14s]
Threads: 2: [F_F] [100.0% done] [   116/ 15944 kb/s] [eta 00m:00s]
Threads: 2: [F_F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_F] [68.8% done] [   836/     0 kb/s] [eta 00m:10s]
Threads: 2: [V_V] [69.7% done] [ 13748/     0 kb/s] [eta 00m:10s]
Threads: 2: [V_V] [80.0% done] [ 31680/     0 kb/s] [eta 00m:06s]
Threads: 2: [V_V] [86.2% done] [ 32716/     0 kb/s] [eta 00m:04s]
Threads: 2: [V_V] [96.3% done] [ 36800/     0 kb/s] [eta 00m:01s]
Threads: 2: [V_V] [100.0% done] [ 35304/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [100.0% done] [ 30144/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=12012
  read : io=100MiB, bw=3,723KiB/s, runt= 28158msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  851, avg=33.49, stdev=78.55
    bw (KiB/s) : min=    4, max=26022, per=112.03%, avg=12230.27, stdev=9593.77
  write: io=98MiB, bw=4,627KiB/s, runt= 22320msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  678, avg= 2.90, stdev=25.60
    bw (KiB/s) : min=    0, max=55828, per=217.99%, avg=27564.67, stdev=27920.56
  cpu          : usr=3.14%, sys=1.31%, ctx=8714
  IO depths    : 1=2.3%, 2=51.0%, 4=34.9%, 8=11.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=42.6%, 4=1.3%, 10=27.2%, 20=17.8%, 50=3.1%, 100=1.2%
     lat (msec): 250=5.9%, 500=0.3%, 750=0.3%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12013
  read : io=100MiB, bw=5,466KiB/s, runt= 19182msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1142, avg=34.35, stdev=78.91
    bw (KiB/s) : min=   10, max=22901, per=109.59%, avg=11964.47, stdev=8524.38
  write: io=96,912KiB, bw=7,474KiB/s, runt= 13276msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  647, avg= 2.84, stdev=34.28
    bw (KiB/s) : min=    0, max=102293, per=270.95%, avg=34261.00, stdev=58917.95
  cpu          : usr=4.67%, sys=2.11%, ctx=6769
  IO depths    : 1=1.3%, 2=56.8%, 4=29.9%, 8=11.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.3%, 4=2.1%, 10=18.8%, 20=14.5%, 50=5.4%, 100=5.7%
     lat (msec): 250=3.1%, 500=0.5%, 750=0.3%, 1000=0.1%, >=2000=0.1%
fio: (groupid=0): err= 0: pid=12014
  read : io=100MiB, bw=3,639KiB/s, runt= 28813msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1251, avg=100.44, stdev=219.61
    bw (KiB/s) : min=   10, max=26476, per=37.12%, avg=4052.53, stdev=6489.62
  write: io=82,544KiB, bw=3,723KiB/s, runt= 22700msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1015, avg=16.88, stdev=93.42
    bw (KiB/s) : min=    0, max=18291, per=28.25%, avg=3572.10, stdev=6233.40
  cpu          : usr=2.18%, sys=1.14%, ctx=9153
  IO depths    : 1=1.1%, 2=50.8%, 4=30.6%, 8=17.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=45.6%, 4=0.3%, 10=18.3%, 20=16.3%, 50=4.7%, 100=0.5%
     lat (msec): 250=6.3%, 500=3.2%, 750=2.5%, 1000=1.5%, >=2000=0.7%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=10,917KiB/s, minb=3,639KiB/s, maxb=5,466KiB/s, mint=19182msec, maxt=28813msec
  WRITE: io=274MiB, aggrb=12,645KiB/s, minb=3,723KiB/s, maxb=7,474KiB/s, mint=19182msec, maxt=28813msec

Disk stats (read/write):
  sda: ios=3380/2886, merge=1430/67023, ticks=92140/2918732, in_queue=3016668, util=99.03%
2.43user 1.15system 0:29.23elapsed 12%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2491minor)pagefaults 0swaps