fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [6.8% done] [ 10188/ 76996 kb/s] [eta 00m:41s]
Threads: 3: [mmF] [36.4% done] [ 10072/ 52088 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [35.7% done] [  1096/ 48472 kb/s] [eta 00m:09s]
Threads: 3: [mFF] [37.5% done] [  1436/   332 kb/s] [eta 00m:10s]
Threads: 3: [mFF] [41.2% done] [   644/  4204 kb/s] [eta 00m:10s]
Threads: 3: [mFF] [40.0% done] [   260/     0 kb/s] [eta 00m:12s]
Threads: 3: [mFF] [40.9% done] [  1296/     0 kb/s] [eta 00m:13s]
Threads: 3: [mFF] [55.6% done] [   932/ 21212 kb/s] [eta 00m:08s]
Threads: 3: [FFF] [100.0% done] [     0/ 18608 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.0% done] [  9736/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 26036/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 28620/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 23668/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [91.3% done] [ 31548/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.7% done] [ 35388/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 34020/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 26678/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 28656/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=20644
  read : io=100MiB, bw=4,007KiB/s, runt= 26165msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1144, avg=85.12, stdev=157.74
    bw (KiB/s) : min=   13, max=18009, per=43.08%, avg=5179.53, stdev=5144.50
  write: io=82,840KiB, bw=5,117KiB/s, runt= 16576msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  563, avg= 4.48, stdev=37.26
    bw (KiB/s) : min=    0, max=20414, per=34.18%, avg=5483.50, stdev=9970.16
  cpu          : usr=2.54%, sys=1.70%, ctx=5600
  IO depths    : 1=1.6%, 2=52.6%, 4=29.9%, 8=16.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=46.7%, 4=0.3%, 10=18.6%, 20=13.1%, 50=5.8%, 100=1.9%
     lat (msec): 250=7.6%, 500=3.9%, 750=1.5%, 1000=0.4%, >=2000=0.2%
fio: (groupid=0): err= 0: pid=20645
  read : io=100MiB, bw=4,032KiB/s, runt= 26005msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  695, avg=60.61, stdev=101.38
    bw (KiB/s) : min=    7, max=14921, per=60.47%, avg=7269.96, stdev=4759.02
  write: io=83,832KiB, bw=5,181KiB/s, runt= 16568msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  199, avg= 1.01, stdev=10.71
    bw (KiB/s) : min=    0, max=25792, per=80.39%, avg=12896.00, stdev=18237.70
  cpu          : usr=2.57%, sys=1.54%, ctx=5548
  IO depths    : 1=1.1%, 2=52.5%, 4=30.7%, 8=15.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=47.0%, 4=0.7%, 10=18.5%, 20=13.5%, 50=5.7%, 100=3.0%
     lat (msec): 250=8.5%, 500=2.3%, 750=0.6%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=20646
  read : io=100MiB, bw=4,060KiB/s, runt= 25825msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  608, avg=56.11, stdev=95.77
    bw (KiB/s) : min=    1, max=24797, per=63.11%, avg=7586.67, stdev=6374.12
  write: io=93,020KiB, bw=5,747KiB/s, runt= 16572msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  207, avg= 1.39, stdev=12.14
    bw (KiB/s) : min=    0, max=42477, per=127.05%, avg=20382.00, stdev=21290.25
  cpu          : usr=3.00%, sys=1.46%, ctx=5501
  IO depths    : 1=1.4%, 2=53.5%, 4=31.4%, 8=13.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=47.9%, 4=0.6%, 10=19.6%, 20=14.9%, 50=4.6%, 100=1.8%
     lat (msec): 250=7.2%, 500=3.2%, 750=0.2%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,022KiB/s, minb=4,007KiB/s, maxb=4,060KiB/s, mint=25825msec, maxt=26165msec
  WRITE: io=254MiB, aggrb=16,042KiB/s, minb=5,117KiB/s, maxb=5,747KiB/s, mint=25825msec, maxt=26165msec

Disk stats (read/write):
  sda: ios=3802/2223, merge=1449/62614, ticks=103380/1783400, in_queue=1887680, util=99.11%
2.16user 1.29system 0:26.49elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2477minor)pagefaults 0swaps