fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [5.0% done] [  2572/     0 kb/s] [eta 00m:57s]
Threads: 3: [mmm] [6.7% done] [  3668/   932 kb/s] [eta 00m:56s]
Threads: 3: [Fmm] [35.7% done] [  4640/113620 kb/s] [eta 00m:09s]
Threads: 3: [Fmm] [37.5% done] [  1388/   836 kb/s] [eta 00m:10s]
Threads: 3: [Fmm] [38.9% done] [  2216/ 13732 kb/s] [eta 00m:11s]
Threads: 3: [FmF] [38.1% done] [  1065/  8472 kb/s] [eta 00m:13s]
Threads: 3: [FmF] [39.1% done] [  1560/     0 kb/s] [eta 00m:14s]
Threads: 3: [FmF] [40.0% done] [  1004/     0 kb/s] [eta 00m:15s]
Threads: 3: [FmF] [40.7% done] [   964/     0 kb/s] [eta 00m:16s]
Threads: 3: [FmF] [41.4% done] [   920/   500 kb/s] [eta 00m:17s]
Threads: 3: [FmF] [41.9% done] [   884/     0 kb/s] [eta 00m:18s]
Threads: 3: [FmF] [42.4% done] [   836/     0 kb/s] [eta 00m:19s]
Threads: 3: [FmF] [42.9% done] [   904/     0 kb/s] [eta 00m:20s]
Threads: 3: [VmV] [44.4% done] [  1756/     0 kb/s] [eta 00m:20s]
Threads: 3: [VmV] [43.6% done] [ 20456/     0 kb/s] [eta 00m:22s]
Threads: 3: [VmV] [43.9% done] [ 31992/     0 kb/s] [eta 00m:23s]
Threads: 3: [VmV] [44.2% done] [ 31008/    40 kb/s] [eta 00m:24s]
Threads: 3: [VmV] [44.4% done] [ 36920/     0 kb/s] [eta 00m:25s]
Threads: 3: [VmV] [44.7% done] [ 28628/   167 kb/s] [eta 00m:26s]
Threads: 3: [VmV] [44.9% done] [ 31432/     0 kb/s] [eta 00m:27s]
Threads: 1: [_F_] [100.0% done] [ 11244/ 33768 kb/s] [eta 00m:00s]
Threads: 1: [_F_] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [_V_] [71.4% done] [  6712/     0 kb/s] [eta 00m:10s]
Threads: 1: [_V_] [92.9% done] [ 31412/     0 kb/s] [eta 00m:02s]
Threads: 1: [_V_] [100.0% done] [ 27924/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=12368
  read : io=100MiB, bw=4,569KiB/s, runt= 22945msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  918, avg=45.26, stdev=110.61
    bw (KiB/s) : min=    7, max=21764, per=84.27%, avg=9400.80, stdev=8609.16
  write: io=99,144KiB, bw=6,285KiB/s, runt= 16152msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  655, avg= 3.06, stdev=35.52
    bw (KiB/s) : min=    0, max=16953, per=52.77%, avg=5835.33, stdev=9632.15
  cpu          : usr=3.50%, sys=1.87%, ctx=5226
  IO depths    : 1=2.1%, 2=56.3%, 4=31.0%, 8=10.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.3%, 4=0.7%, 10=24.9%, 20=11.5%, 50=4.8%, 100=0.4%
     lat (msec): 250=6.6%, 500=0.6%, 750=0.8%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12369
  read : io=100MiB, bw=3,718KiB/s, runt= 28199msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1999, avg=109.47, stdev=261.16
    bw (KiB/s) : min=   50, max=32268, per=35.36%, avg=3944.63, stdev=8947.62
  write: io=82,076KiB, bw=3,326KiB/s, runt= 25265msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1743, avg=13.34, stdev=101.34
    bw (KiB/s) : min=    0, max=13778, per=15.14%, avg=1673.89, stdev=4542.16
  cpu          : usr=2.57%, sys=1.08%, ctx=6065
  IO depths    : 1=2.0%, 2=48.9%, 4=30.0%, 8=19.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=42.5%, 4=1.2%, 10=19.0%, 20=17.7%, 50=8.3%, 100=1.6%
     lat (msec): 250=1.2%, 500=2.0%, 750=5.1%, 1000=0.2%, >=2000=1.1%
fio: (groupid=0): err= 0: pid=12370
  read : io=100MiB, bw=4,573KiB/s, runt= 22926msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  969, avg=58.72, stdev=138.93
    bw (KiB/s) : min=    4, max=20520, per=68.85%, avg=7679.83, stdev=7618.02
  write: io=91,640KiB, bw=5,806KiB/s, runt= 16160msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  560, avg= 3.71, stdev=34.58
    bw (KiB/s) : min=    0, max=125247, per=300.83%, avg=33269.25, stdev=61414.98
  cpu          : usr=3.05%, sys=1.52%, ctx=5373
  IO depths    : 1=1.4%, 2=54.4%, 4=31.0%, 8=13.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.2%, 4=0.8%, 10=19.2%, 20=16.1%, 50=4.3%, 100=1.5%
     lat (msec): 250=7.1%, 500=0.9%, 750=0.8%, 1000=0.9%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,155KiB/s, minb=3,718KiB/s, maxb=4,573KiB/s, mint=22926msec, maxt=28199msec
  WRITE: io=266MiB, aggrb=11,059KiB/s, minb=3,326KiB/s, maxb=6,285KiB/s, mint=22926msec, maxt=28199msec

Disk stats (read/write):
  sda: ios=3568/2676, merge=1328/65331, ticks=89344/2228636, in_queue=2323240, util=97.68%
2.29user 1.12system 0:28.62elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2487minor)pagefaults 0swaps