fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [12.0% done] [ 11408/  8480 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [16.0% done] [  9764/ 10040 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [20.8% done] [ 15488/  1876 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [25.0% done] [ 15484/  1672 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [26.9% done] [ 10976/  6172 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [29.6% done] [  6972/  6784 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [32.1% done] [  4400/ 10072 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [35.7% done] [  7388/  8908 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [39.3% done] [ 13548/  1108 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [41.4% done] [  9180/  5384 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [44.8% done] [ 12096/   972 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [46.7% done] [ 12592/     0 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [50.0% done] [  9092/  2928 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [53.3% done] [  5484/  5784 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [54.8% done] [ 10568/   252 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [58.1% done] [  5708/  5400 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [59.4% done] [  3528/  6364 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [62.5% done] [  8576/   812 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [65.6% done] [  5436/  3312 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [68.8% done] [ 16128/     0 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.9% done] [ 20020/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [77.4% done] [ 18916/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [80.6% done] [ 17768/     0 kb/s] [eta 00m:06s]
Threads: 2: [VV_] [83.9% done] [ 17620/     0 kb/s] [eta 00m:05s]
fio: (groupid=0): err= 0: pid=12711
  read : io=100MiB, bw=3,882KiB/s, runt= 27008msec
    slat (msec): min=    0, max= 5217, avg=993.55, stdev=1623.85
    clat (msec): min=    2, max=  617, avg=94.38, stdev=93.43
    bw (KiB/s) : min=   52, max= 9443, per=34.42%, avg=4008.52, stdev=2437.70
  write: io=32,804KiB, bw=1,541KiB/s, runt= 21786msec
    slat (msec): min=    0, max=    3, avg= 0.05, stdev= 0.27
    clat (msec): min=    0, max=  721, avg=103.51, stdev=115.75
    bw (KiB/s) : min=    0, max= 5604, per=54.84%, avg=2482.26, stdev=2146.57
  cpu          : usr=3.45%, sys=0.24%, ctx=1789
  IO depths    : 1=0.1%, 2=0.2%, 4=13.7%, 8=85.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.5%, 4=0.4%, 10=3.7%, 20=13.6%, 50=25.7%, 100=20.5%
     lat (msec): 250=26.4%, 500=8.3%, 750=0.8%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12712
  read : io=100MiB, bw=3,906KiB/s, runt= 26845msec
    slat (msec): min=    0, max= 6513, avg=1299.89, stdev=2090.00
    clat (msec): min=    2, max=  738, avg=83.34, stdev=75.94
    bw (KiB/s) : min=   20, max=12544, per=39.75%, avg=4629.67, stdev=3013.25
  write: io=38,136KiB, bw=1,921KiB/s, runt= 20321msec
    slat (msec): min=    0, max=    3, avg= 0.06, stdev= 0.31
    clat (msec): min=    0, max=  868, avg=115.80, stdev=118.93
    bw (KiB/s) : min=    0, max= 9497, per=63.64%, avg=2880.21, stdev=2509.83
  cpu          : usr=3.20%, sys=0.27%, ctx=1817
  IO depths    : 1=0.1%, 2=0.2%, 4=13.5%, 8=86.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.1%, 4=0.5%, 10=2.5%, 20=10.2%, 50=24.9%, 100=26.8%
     lat (msec): 250=27.8%, 500=5.4%, 750=0.4%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12713
  read : io=100MiB, bw=4,032KiB/s, runt= 26006msec
    slat (msec): min=    0, max= 4681, avg=630.81, stdev=1222.89
    clat (msec): min=    2, max=  627, avg=94.34, stdev=82.41
    bw (KiB/s) : min=   31, max=10115, per=35.83%, avg=4173.00, stdev=2592.36
  write: io=25,372KiB, bw=1,216KiB/s, runt= 21354msec
    slat (msec): min=    0, max=    2, avg= 0.04, stdev= 0.24
    clat (msec): min=    0, max=  999, avg=112.71, stdev=104.40
    bw (KiB/s) : min=    0, max= 6864, per=48.56%, avg=2197.74, stdev=2111.78
  cpu          : usr=3.17%, sys=0.14%, ctx=1781
  IO depths    : 1=0.1%, 2=0.2%, 4=9.5%, 8=90.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.3%, 4=0.3%, 10=2.5%, 20=9.3%, 50=22.5%, 100=28.1%
     lat (msec): 250=30.3%, 500=6.3%, 750=0.3%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,647KiB/s, minb=3,882KiB/s, maxb=4,032KiB/s, mint=26006msec, maxt=27008msec
  WRITE: io=96,312KiB, aggrb=4,526KiB/s, minb=1,216KiB/s, maxb=1,921KiB/s, mint=26006msec, maxt=27008msec

Disk stats (read/write):
  sda: ios=5030/1582, merge=1443/363, ticks=477136/237824, in_queue=731244, util=99.57%
2.66user 0.21system 0:27.30elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2382minor)pagefaults 0swaps