fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.5% done] [ 13713/  4920 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [16.7% done] [ 15856/  4676 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [20.8% done] [ 14024/  4660 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [24.0% done] [ 10324/  5160 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [26.9% done] [  8860/  8104 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [30.8% done] [  9740/  5104 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [34.6% done] [ 10830/  4492 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [38.5% done] [ 13456/  1860 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [40.7% done] [  8200/  4460 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [42.9% done] [  6472/  7532 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [46.4% done] [  5752/  7876 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [50.0% done] [ 11672/  1064 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [53.6% done] [  9992/  2632 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [55.2% done] [  8144/  3492 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [56.7% done] [  7736/  3148 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [60.0% done] [  9788/  1012 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [63.3% done] [  9760/  1632 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [64.5% done] [  5460/  4256 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [67.7% done] [  7412/  1984 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.0% done] [ 17880/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [74.2% done] [ 16832/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [77.4% done] [ 18236/     0 kb/s] [eta 00m:07s]
Threads: 2: [VV_] [83.3% done] [ 19216/     0 kb/s] [eta 00m:05s]
fio: (groupid=0): err= 0: pid=855
  read : io=100MiB, bw=3,965KiB/s, runt= 26441msec
    slat (msec): min=    0, max= 5237, avg=1043.45, stdev=1674.72
    clat (msec): min=    3, max=  829, avg=86.82, stdev=85.69
    bw (KiB/s) : min=   89, max=11494, per=34.84%, avg=4145.08, stdev=2895.63
  write: io=35,264KiB, bw=1,699KiB/s, runt= 21244msec
    slat (msec): min=    0, max=    3, avg= 0.06, stdev= 0.27
    clat (msec): min=    1, max= 1063, avg=122.46, stdev=129.46
    bw (KiB/s) : min=    0, max= 7080, per=60.60%, avg=2561.16, stdev=2197.97
  cpu          : usr=3.56%, sys=0.20%, ctx=1773
  IO depths    : 1=0.1%, 2=0.3%, 4=12.6%, 8=87.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.0%, 4=0.4%, 10=3.8%, 20=12.6%, 50=25.8%, 100=21.3%
     lat (msec): 250=29.6%, 500=5.4%, 750=0.8%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=856
  read : io=100MiB, bw=3,975KiB/s, runt= 26373msec
    slat (msec): min=    0, max= 6012, avg=1176.28, stdev=1932.54
    clat (msec): min=    3, max=  606, avg=91.70, stdev=78.02
    bw (KiB/s) : min=   36, max=10188, per=35.54%, avg=4228.20, stdev=2481.85
  write: io=35,380KiB, bw=1,783KiB/s, runt= 20318msec
    slat (msec): min=    0, max=    7, avg= 0.08, stdev= 0.50
    clat (msec): min=    0, max=  775, avg=105.58, stdev=106.71
    bw (KiB/s) : min=    0, max=11298, per=69.00%, avg=2916.04, stdev=2941.60
  cpu          : usr=3.38%, sys=0.30%, ctx=1733
  IO depths    : 1=0.1%, 2=0.2%, 4=13.0%, 8=86.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.2%, 4=0.3%, 10=3.1%, 20=8.9%, 50=23.4%, 100=27.4%
     lat (msec): 250=29.5%, 500=5.8%, 750=0.3%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=857
  read : io=100MiB, bw=4,172KiB/s, runt= 25133msec
    slat (msec): min=    0, max= 3489, avg=324.09, stdev=797.69
    clat (msec): min=    3, max=  672, avg=99.87, stdev=84.00
    bw (KiB/s) : min=   23, max= 7999, per=36.94%, avg=4394.19, stdev=2043.46
  write: io=18,116KiB, bw=862KiB/s, runt= 21503msec
    slat (msec): min=    0, max=    2, avg= 0.06, stdev= 0.30
    clat (msec): min=    0, max=  990, avg=113.52, stdev=106.45
    bw (KiB/s) : min=    0, max= 5443, per=59.30%, avg=2506.15, stdev=1948.80
  cpu          : usr=3.41%, sys=0.25%, ctx=1752
  IO depths    : 1=0.2%, 2=0.3%, 4=7.8%, 8=91.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.2%, 4=0.3%, 10=1.7%, 20=9.1%, 50=21.5%, 100=28.2%
     lat (msec): 250=31.1%, 500=7.4%, 750=0.3%, 1000=0.1%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,897KiB/s, minb=3,965KiB/s, maxb=4,172KiB/s, mint=25133msec, maxt=26441msec
  WRITE: io=88,760KiB, aggrb=4,226KiB/s, minb=862KiB/s, maxb=1,783KiB/s, mint=25133msec, maxt=26441msec

Disk stats (read/write):
  sda: ios=4992/1495, merge=1396/422, ticks=489216/191568, in_queue=680784, util=99.43%
2.74user 0.22system 0:26.69elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2379minor)pagefaults 0swaps