fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [15.0% done] [ 15004/ 10148 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [21.1% done] [ 13227/  8857 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [26.3% done] [ 22820/   235 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [30.0% done] [ 17436/  5392 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [35.0% done] [  8622/ 12125 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [40.0% done] [ 16014/  5042 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [42.9% done] [  9233/  9709 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [47.6% done] [ 10942/  7050 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [50.0% done] [  9309/  6814 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [52.2% done] [  8671/  4888 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [56.5% done] [  6241/  8033 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [58.3% done] [  4014/  7363 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [62.5% done] [ 10658/  2287 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [64.0% done] [  5697/  5355 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [68.0% done] [  9610/   524 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 20081/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.1% done] [ 19856/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [80.0% done] [ 19296/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.0% done] [ 20004/     0 kb/s] [eta 00m:04s]
Threads: 2: [_VV] [91.7% done] [ 19788/     0 kb/s] [eta 00m:02s]
fio: (groupid=0): err= 0: pid=28662
  read : io=100MiB, bw=4,802KiB/s, runt= 21834msec
    slat (msec): min=    0, max= 4715, avg=715.42, stdev=1278.17
    clat (msec): min=    2, max=  380, avg=79.57, stdev=71.42
    bw (KiB/s) : min=  126, max=14210, per=39.27%, avg=5502.33, stdev=2896.34
  write: io=27,928KiB, bw=1,666KiB/s, runt= 17165msec
    slat (msec): min=    0, max=    3, avg= 0.07, stdev= 0.32
    clat (msec): min=    1, max=  495, avg=83.32, stdev=74.50
    bw (KiB/s) : min=    0, max= 6458, per=55.71%, avg=3463.29, stdev=2333.45
  cpu          : usr=4.10%, sys=0.33%, ctx=1765
  IO depths    : 1=0.1%, 2=0.2%, 4=12.6%, 8=87.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.1%, 4=0.7%, 10=3.5%, 20=14.2%, 50=25.6%, 100=26.6%
     lat (msec): 250=25.4%, 500=3.9%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=28663
  read : io=100MiB, bw=4,682KiB/s, runt= 22393msec
    slat (msec): min=    0, max= 6025, avg=1535.85, stdev=2052.53
    clat (msec): min=    2, max=  367, avg=72.54, stdev=66.72
    bw (KiB/s) : min=    6, max=11068, per=37.35%, avg=5233.63, stdev=3104.44
  write: io=38,440KiB, bw=2,397KiB/s, runt= 16420msec
    slat (msec): min=    0, max=    9, avg= 0.13, stdev= 0.70
    clat (msec): min=    0, max=  616, avg=72.17, stdev=72.11
    bw (KiB/s) : min=    0, max= 9409, per=53.36%, avg=3317.65, stdev=2963.18
  cpu          : usr=4.27%, sys=0.30%, ctx=1810
  IO depths    : 1=0.1%, 2=0.2%, 4=16.7%, 8=83.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.0%, 4=0.6%, 10=4.9%, 20=14.3%, 50=26.9%, 100=27.6%
     lat (msec): 250=21.8%, 500=2.6%, 750=0.1%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=28664
  read : io=100MiB, bw=4,670KiB/s, runt= 22451msec
    slat (msec): min=    0, max= 5858, avg=1157.81, stdev=1874.50
    clat (msec): min=    0, max=  417, avg=76.08, stdev=72.35
    bw (KiB/s) : min=   25, max=11200, per=35.26%, avg=4940.57, stdev=3191.47
  write: io=37,856KiB, bw=2,323KiB/s, runt= 16682msec
    slat (msec): min=    0, max=    5, avg= 0.10, stdev= 0.43
    clat (msec): min=    0, max=  912, avg=97.09, stdev=106.07
    bw (KiB/s) : min=    0, max=11504, per=51.23%, avg=3184.96, stdev=3510.58
  cpu          : usr=3.99%, sys=0.37%, ctx=1724
  IO depths    : 1=0.1%, 2=0.2%, 4=13.2%, 8=86.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.0%, 4=0.4%, 10=2.7%, 20=11.6%, 50=29.0%, 100=27.7%
     lat (msec): 250=22.7%, 500=4.5%, 750=0.1%, 1000=0.1%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=14,011KiB/s, minb=4,670KiB/s, maxb=4,802KiB/s, mint=21834msec, maxt=22451msec
  WRITE: io=102MiB, aggrb=6,217KiB/s, minb=1,666KiB/s, maxb=2,397KiB/s, mint=21834msec, maxt=22451msec

Disk stats (read/write):
  sda: ios=4457/1718, merge=1488/342, ticks=353668/176344, in_queue=530112, util=99.46%
2.81user 0.23system 0:22.70elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2390minor)pagefaults 0swaps