fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [13.6% done] [ 13088/ 11624 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [19.0% done] [  7808/ 14268 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [23.8% done] [ 12356/  8528 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [27.3% done] [  9896/ 11608 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [31.8% done] [ 14108/  6036 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [38.1% done] [ 12072/  8300 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [40.9% done] [ 10872/  7952 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [45.5% done] [ 12592/  5300 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [50.0% done] [ 12068/  3704 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [52.2% done] [ 10584/  3504 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [56.5% done] [ 12488/  2760 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [60.9% done] [  8408/  4572 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [62.5% done] [  6868/  4076 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [64.0% done] [  8344/  2888 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [68.0% done] [  5332/  4228 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 20415/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 19584/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 22236/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.0% done] [ 18628/     0 kb/s] [eta 00m:04s]
Threads: 2: [_VV] [88.0% done] [ 22216/     0 kb/s] [eta 00m:03s]
fio: (groupid=0): err= 0: pid=32356
  read : io=100MiB, bw=4,754KiB/s, runt= 22055msec
    slat (msec): min=    0, max= 4471, avg=679.68, stdev=1276.62
    clat (msec): min=    2, max=  569, avg=76.34, stdev=71.91
    bw (KiB/s) : min=  131, max=11602, per=37.12%, avg=5079.28, stdev=3060.80
  write: io=31,148KiB, bw=1,833KiB/s, runt= 17396msec
    slat (msec): min=    0, max=    4, avg= 0.07, stdev= 0.36
    clat (msec): min=    0, max=  787, avg=108.13, stdev=114.18
    bw (KiB/s) : min=    0, max= 7283, per=41.83%, avg=2847.15, stdev=2329.41
  cpu          : usr=4.24%, sys=0.34%, ctx=1743
  IO depths    : 1=0.1%, 2=0.3%, 4=11.5%, 8=88.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.4%, 4=0.4%, 10=3.5%, 20=11.4%, 50=27.7%, 100=28.9%
     lat (msec): 250=22.1%, 500=5.0%, 750=0.5%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=32357
  read : io=100MiB, bw=4,637KiB/s, runt= 22613msec
    slat (msec): min=    0, max= 5535, avg=1079.19, stdev=1703.21
    clat (msec): min=    1, max=  423, avg=74.77, stdev=68.59
    bw (KiB/s) : min=   15, max=12215, per=36.01%, avg=4926.38, stdev=3022.69
  write: io=31,640KiB, bw=1,902KiB/s, runt= 17029msec
    slat (msec): min=    0, max=   11, avg= 0.13, stdev= 0.87
    clat (msec): min=    0, max=  855, avg=79.46, stdev=108.49
    bw (KiB/s) : min=    0, max= 7642, per=41.80%, avg=2844.67, stdev=2564.34
  cpu          : usr=4.32%, sys=0.30%, ctx=1884
  IO depths    : 1=0.1%, 2=0.2%, 4=14.2%, 8=85.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=2.3%, 4=1.0%, 10=4.7%, 20=12.1%, 50=28.0%, 100=26.7%
     lat (msec): 250=21.0%, 500=3.6%, 750=0.3%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=32358
  read : io=100MiB, bw=4,560KiB/s, runt= 22991msec
    slat (msec): min=    0, max= 6667, avg=1865.29, stdev=2405.91
    clat (msec): min=    1, max=  439, avg=63.95, stdev=65.77
    bw (KiB/s) : min=  142, max=21628, per=42.51%, avg=5816.07, stdev=4337.00
  write: io=52,840KiB, bw=3,312KiB/s, runt= 16333msec
    slat (msec): min=    0, max=    3, avg= 0.06, stdev= 0.30
    clat (msec): min=    0, max=  829, avg=89.38, stdev=106.21
    bw (KiB/s) : min=    0, max=11481, per=64.89%, avg=4416.61, stdev=3333.09
  cpu          : usr=4.68%, sys=0.35%, ctx=1860
  IO depths    : 1=0.2%, 2=0.4%, 4=15.7%, 8=83.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=2.1%, 4=0.5%, 10=4.8%, 20=15.7%, 50=29.4%, 100=26.0%
     lat (msec): 250=17.6%, 500=3.2%, 750=0.5%, 1000=0.1%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,682KiB/s, minb=4,560KiB/s, maxb=4,754KiB/s, mint=22055msec, maxt=22991msec
  WRITE: io=113MiB, aggrb=6,806KiB/s, minb=1,833KiB/s, maxb=3,312KiB/s, mint=22055msec, maxt=22991msec

Disk stats (read/write):
  sda: ios=4557/1820, merge=1512/448, ticks=321776/237692, in_queue=559468, util=99.42%
3.07user 0.32system 0:23.26elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2374minor)pagefaults 0swaps