fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [12.0% done] [ 15916/  3708 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [15.4% done] [ 13848/  5896 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [19.2% done] [  7736/  8960 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [22.2% done] [ 15536/  1804 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [26.9% done] [ 10684/  6240 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [29.6% done] [  7336/  7296 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [34.6% done] [ 13564/  2348 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [38.5% done] [ 10684/  5392 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [40.7% done] [  8760/  7292 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [42.9% done] [ 10912/  4128 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [46.4% done] [  8224/  4564 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [50.0% done] [  7644/  4444 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [53.6% done] [  9688/  2780 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [55.2% done] [  8752/  2640 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [58.6% done] [  9296/  2120 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [60.0% done] [  8376/  1492 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [63.3% done] [  7592/  1576 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [64.5% done] [ 10324/     0 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [65.6% done] [  6704/  2580 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [68.8% done] [ 15820/   736 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.9% done] [ 19944/     0 kb/s] [eta 00m:09s]
Threads: 2: [EVV] [80.0% done] [ 17948/     0 kb/s] [eta 00m:06s]
Threads: 2: [_VV] [89.3% done] [ 20028/     0 kb/s] [eta 00m:03s]
fio: (groupid=0): err= 0: pid=2916
  read : io=100MiB, bw=4,290KiB/s, runt= 24442msec
    slat (msec): min=    0, max= 2843, avg=182.21, stdev=563.77
    clat (msec): min=    3, max=  853, avg=106.75, stdev=96.86
    bw (KiB/s) : min=  292, max=10854, per=36.84%, avg=4396.95, stdev=2588.14
  write: io=10,532KiB, bw=497KiB/s, runt= 21682msec
    slat (msec): min=    0, max=    3, avg= 0.08, stdev= 0.37
    clat (msec): min=    0, max=  670, avg=92.70, stdev=116.59
    bw (KiB/s) : min=    0, max= 5357, per=52.45%, avg=2174.00, stdev=2257.60
  cpu          : usr=3.42%, sys=0.29%, ctx=1687
  IO depths    : 1=0.2%, 2=0.2%, 4=6.4%, 8=93.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.5%, 4=0.5%, 10=2.9%, 20=8.4%, 50=18.7%, 100=29.5%
     lat (msec): 250=31.6%, 500=6.7%, 750=0.8%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2917
  read : io=100MiB, bw=3,978KiB/s, runt= 26353msec
    slat (msec): min=    0, max= 5306, avg=1286.87, stdev=1866.51
    clat (msec): min=    2, max=  580, avg=75.62, stdev=75.18
    bw (KiB/s) : min=   71, max=18651, per=41.01%, avg=4895.33, stdev=3910.08
  write: io=44,956KiB, bw=2,187KiB/s, runt= 21046msec
    slat (msec): min=    0, max=    2, avg= 0.04, stdev= 0.23
    clat (msec): min=    0, max=  843, avg=114.38, stdev=117.29
    bw (KiB/s) : min=    0, max= 6480, per=77.89%, avg=3228.46, stdev=2182.60
  cpu          : usr=3.64%, sys=0.32%, ctx=1841
  IO depths    : 1=0.1%, 2=0.2%, 4=15.5%, 8=84.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.9%, 4=0.6%, 10=2.7%, 20=15.3%, 50=24.3%, 100=26.2%
     lat (msec): 250=24.1%, 500=4.9%, 750=0.7%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2918
  read : io=100MiB, bw=4,100KiB/s, runt= 25573msec
    slat (msec): min=    0, max= 4170, avg=662.86, stdev=1245.88
    clat (msec): min=    1, max=  622, avg=88.06, stdev=76.90
    bw (KiB/s) : min=   37, max=12328, per=34.14%, avg=4075.16, stdev=2902.86
  write: io=32,296KiB, bw=1,537KiB/s, runt= 21510msec
    slat (msec): min=    0, max=    3, avg= 0.08, stdev= 0.33
    clat (msec): min=    0, max= 1036, avg=119.26, stdev=125.45
    bw (KiB/s) : min=    0, max= 8963, per=58.33%, avg=2417.91, stdev=2440.81
  cpu          : usr=3.83%, sys=0.30%, ctx=1836
  IO depths    : 1=0.1%, 2=0.3%, 4=10.5%, 8=89.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.8%, 4=0.3%, 10=2.2%, 20=9.5%, 50=24.5%, 100=27.3%
     lat (msec): 250=29.7%, 500=5.0%, 750=0.5%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,936KiB/s, minb=3,978KiB/s, maxb=4,290KiB/s, mint=24442msec, maxt=26353msec
  WRITE: io=87,784KiB, aggrb=4,145KiB/s, minb=497KiB/s, maxb=2,187KiB/s, mint=24442msec, maxt=26353msec

Disk stats (read/write):
  sda: ios=5112/1507, merge=1231/240, ticks=481984/258168, in_queue=760960, util=99.60%
2.81user 0.24system 0:26.64elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2396minor)pagefaults 0swaps