fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [17.6% done] [  1836/     0 kb/s] [eta 00m:14s]
Threads: 3: [Fmm] [18.2% done] [  2424/     0 kb/s] [eta 00m:18s]
Threads: 3: [Fmm] [19.2% done] [  1520/ 18632 kb/s] [eta 00m:21s]
Threads: 3: [FFm] [20.0% done] [  1132/  8752 kb/s] [eta 00m:24s]
Threads: 3: [FFm] [20.6% done] [  1308/     0 kb/s] [eta 00m:27s]
Threads: 3: [FFm] [25.0% done] [  1172/  5212 kb/s] [eta 00m:24s]
Threads: 3: [FFm] [25.7% done] [   940/     0 kb/s] [eta 00m:26s]
Threads: 3: [FFm] [33.3% done] [  1020/ 11112 kb/s] [eta 00m:20s]
Threads: 3: [FFm] [34.4% done] [  1008/     0 kb/s] [eta 00m:21s]
Threads: 3: [FFm] [38.7% done] [  1048/  5136 kb/s] [eta 00m:19s]
Threads: 3: [VFm] [40.6% done] [ 10036/  1244 kb/s] [eta 00m:19s]
Threads: 3: [VFm] [58.3% done] [ 12672/ 25716 kb/s] [eta 00m:10s]
Threads: 3: [VFm] [57.7% done] [ 21312/     0 kb/s] [eta 00m:11s]
Threads: 3: [VFm] [57.1% done] [ 22044/   220 kb/s] [eta 00m:12s]
Threads: 3: [VFm] [58.6% done] [ 21688/     0 kb/s] [eta 00m:12s]
Threads: 2: [_Fm] [58.1% done] [ 14204/    32 kb/s] [eta 00m:13s]
Threads: 2: [_FF] [100.0% done] [     0/ 14858 kb/s] [eta 00m:00s]
Threads: 2: [_FF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [_FF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [68.8% done] [  4220/     0 kb/s] [eta 00m:10s]
Threads: 2: [_VV] [71.9% done] [ 24872/     0 kb/s] [eta 00m:09s]
Threads: 2: [_VV] [82.8% done] [ 30408/     0 kb/s] [eta 00m:05s]
Threads: 2: [_VV] [89.3% done] [ 27952/     0 kb/s] [eta 00m:03s]
Threads: 2: [_VV] [100.0% done] [ 29048/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 33260/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=16234
  read : io=100MiB, bw=5,728KiB/s, runt= 18249msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  471, avg=28.63, stdev=50.10
    bw (KiB/s) : min=    7, max=23609, per=145.30%, avg=16018.33, stdev=8005.75
  write: io=98MiB, bw=8,107KiB/s, runt= 12636msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  302, avg= 1.01, stdev=11.80
    bw (KiB/s) : min=    0, max=98705, per=516.27%, avg=65333.67, stdev=56585.00
  cpu          : usr=5.70%, sys=2.19%, ctx=4590
  IO depths    : 1=1.4%, 2=56.5%, 4=31.4%, 8=10.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.0%, 4=2.7%, 10=22.1%, 20=13.0%, 50=5.3%, 100=6.0%
     lat (msec): 250=2.3%, 500=0.5%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16235
  read : io=100MiB, bw=3,717KiB/s, runt= 28205msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  998, avg=46.47, stdev=106.73
    bw (KiB/s) : min=    5, max=22667, per=83.23%, avg=9175.29, stdev=7966.68
  write: io=91,560KiB, bw=4,242KiB/s, runt= 22100msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  583, avg= 2.85, stdev=23.53
    bw (KiB/s) : min=    0, max=16373, per=78.97%, avg=9994.00, stdev=8764.70
  cpu          : usr=2.75%, sys=1.65%, ctx=6868
  IO depths    : 1=1.4%, 2=51.4%, 4=32.8%, 8=14.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=45.4%, 4=1.3%, 10=19.4%, 20=16.8%, 50=6.6%, 100=1.8%
     lat (msec): 250=6.7%, 500=1.1%, 750=0.5%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16236
  read : io=100MiB, bw=3,678KiB/s, runt= 28505msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1410, avg=103.08, stdev=218.14
    bw (KiB/s) : min=   11, max=19104, per=35.84%, avg=3950.69, stdev=5897.46
  write: io=81,516KiB, bw=3,777KiB/s, runt= 22100msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1043, avg=15.22, stdev=85.93
    bw (KiB/s) : min=    0, max=10955, per=26.66%, avg=3373.75, stdev=3653.06
  cpu          : usr=2.54%, sys=1.38%, ctx=7162
  IO depths    : 1=1.7%, 2=46.1%, 4=33.0%, 8=19.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=40.6%, 4=0.1%, 10=16.1%, 20=20.2%, 50=6.5%, 100=1.6%
     lat (msec): 250=7.1%, 500=2.8%, 750=3.1%, 1000=0.8%, >=2000=0.7%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,024KiB/s, minb=3,678KiB/s, maxb=5,728KiB/s, mint=18249msec, maxt=28505msec
  WRITE: io=267MiB, aggrb=12,655KiB/s, minb=3,777KiB/s, maxb=8,107KiB/s, mint=18249msec, maxt=28505msec

Disk stats (read/write):
  sda: ios=3480/2811, merge=1240/65290, ticks=88428/2609640, in_queue=2698688, util=98.55%
2.60user 1.31system 0:28.86elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2485minor)pagefaults 0swaps