fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.1% done] [  7610/ 11735 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [16.0% done] [ 15928/  5063 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [20.8% done] [  8582/  9004 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [24.0% done] [ 13291/  3933 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [28.0% done] [ 10240/  5428 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [30.8% done] [ 13819/   247 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [33.3% done] [  9134/  6343 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [35.7% done] [ 11190/  3961 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [37.9% done] [  9602/  5388 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [41.4% done] [ 12718/  2759 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [43.3% done] [  9642/  4295 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [45.2% done] [  9512/  3840 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [48.4% done] [  7513/  4697 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [50.0% done] [  6225/  3791 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [53.1% done] [  7407/  3762 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [56.2% done] [ 10105/  1414 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [59.4% done] [ 11138/   321 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [60.6% done] [  7757/  1117 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [63.6% done] [  3827/  5180 kb/s] [eta 00m:12s]
Threads: 3: [VVV] [68.8% done] [ 10166/     8 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.9% done] [ 18704/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [75.0% done] [ 20228/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [80.6% done] [ 18842/     0 kb/s] [eta 00m:06s]
Threads: 2: [VVE] [86.7% done] [ 18598/     0 kb/s] [eta 00m:04s]
fio: (groupid=0): err= 0: pid=25606
  read : io=100MiB, bw=3,886KiB/s, runt= 26981msec
    slat (msec): min=    0, max= 5302, avg=930.68, stdev=1609.98
    clat (msec): min=    0, max=  768, avg=85.97, stdev=84.09
    bw (KiB/s) : min=   20, max=10595, per=36.41%, avg=4232.93, stdev=2840.57
  write: io=35,336KiB, bw=1,670KiB/s, runt= 21657msec
    slat (msec): min=    0, max=    9, avg= 0.16, stdev= 0.81
    clat (msec): min=    0, max=  870, avg=124.94, stdev=164.59
    bw (KiB/s) : min=    0, max= 6743, per=51.40%, avg=2350.70, stdev=1968.67
  cpu          : usr=3.59%, sys=0.28%, ctx=1814
  IO depths    : 1=0.2%, 2=0.3%, 4=12.3%, 8=87.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.7%, 4=0.4%, 10=4.5%, 20=14.8%, 50=23.6%, 100=18.9%
     lat (msec): 250=28.6%, 500=6.0%, 750=0.6%, 1000=0.7%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25607
  read : io=100MiB, bw=3,875KiB/s, runt= 27054msec
    slat (msec): min=    0, max= 7046, avg=1594.45, stdev=2392.34
    clat (msec): min=    0, max=  468, avg=86.30, stdev=73.34
    bw (KiB/s) : min=   33, max=10530, per=36.57%, avg=4251.78, stdev=2741.77
  write: io=38,036KiB, bw=1,938KiB/s, runt= 20089msec
    slat (msec): min=    0, max=   11, avg= 0.16, stdev= 0.98
    clat (msec): min=    0, max=  835, avg=112.13, stdev=114.61
    bw (KiB/s) : min=    0, max= 8505, per=59.15%, avg=2704.72, stdev=2462.27
  cpu          : usr=3.64%, sys=0.24%, ctx=1739
  IO depths    : 1=0.2%, 2=0.3%, 4=14.2%, 8=85.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.0%, 4=0.5%, 10=2.8%, 20=9.6%, 50=24.4%, 100=27.1%
     lat (msec): 250=29.1%, 500=4.8%, 750=0.5%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25608
  read : io=100MiB, bw=4,027KiB/s, runt= 26037msec
    slat (msec): min=    0, max= 5593, avg=694.09, stdev=1452.98
    clat (msec): min=    6, max=  572, avg=99.05, stdev=77.52
    bw (KiB/s) : min=   35, max=10775, per=37.29%, avg=4335.61, stdev=2285.65
  write: io=23,360KiB, bw=1,138KiB/s, runt= 21007msec
    slat (msec): min=    0, max=    2, avg= 0.05, stdev= 0.27
    clat (msec): min=    0, max=  819, avg=108.32, stdev=123.47
    bw (KiB/s) : min=    0, max= 6261, per=55.45%, avg=2535.62, stdev=2335.04
  cpu          : usr=3.32%, sys=0.37%, ctx=1738
  IO depths    : 1=0.2%, 2=0.3%, 4=9.1%, 8=90.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.0%, 4=0.1%, 10=1.5%, 20=8.1%, 50=21.1%, 100=29.3%
     lat (msec): 250=31.9%, 500=6.4%, 750=0.3%, 1000=0.2%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,627KiB/s, minb=3,875KiB/s, maxb=4,027KiB/s, mint=26037msec, maxt=27054msec
  WRITE: io=96,732KiB, aggrb=4,573KiB/s, minb=1,138KiB/s, maxb=1,938KiB/s, mint=26037msec, maxt=27054msec

Disk stats (read/write):
  sda: ios=5029/1573, merge=1452/545, ticks=469752/207384, in_queue=677144, util=99.55%
2.88user 0.36system 0:27.40elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2386minor)pagefaults 0swaps