fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.1% done] [ 16959/  2213 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [15.4% done] [ 18664/  1933 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [19.2% done] [  9601/  6159 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [24.0% done] [  4812/ 13217 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [26.9% done] [ 13910/  2150 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [28.6% done] [ 13950/   901 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [33.3% done] [ 13363/  1378 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [35.7% done] [  9377/  5297 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [40.7% done] [ 10417/  3733 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [44.4% done] [ 11630/  5336 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [46.4% done] [  8719/  5249 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [50.0% done] [ 13650/   126 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [51.7% done] [  5210/  6384 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [55.2% done] [  8424/  2473 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [56.7% done] [  8727/  1961 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [60.0% done] [  6238/  4769 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [61.3% done] [  5498/  4005 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [62.5% done] [  8050/   834 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [67.7% done] [  8692/   441 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [68.8% done] [ 11437/  1417 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [74.2% done] [ 19022/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [77.4% done] [ 16344/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [80.6% done] [ 16746/     0 kb/s] [eta 00m:06s]
fio: (groupid=0): err= 0: pid=30687
  read : io=100MiB, bw=4,031KiB/s, runt= 26012msec
    slat (msec): min=    0, max= 4340, avg=497.38, stdev=1061.28
    clat (msec): min=    3, max=  640, avg=100.73, stdev=84.84
    bw (KiB/s) : min=  168, max= 8686, per=34.01%, avg=4032.20, stdev=2214.55
  write: io=21,832KiB, bw=1,023KiB/s, runt= 21842msec
    slat (msec): min=    0, max=    3, avg= 0.07, stdev= 0.38
    clat (msec): min=    0, max=  884, avg=96.46, stdev=104.27
    bw (KiB/s) : min=    0, max= 4831, per=50.20%, avg=1769.18, stdev=1685.34
  cpu          : usr=3.71%, sys=0.17%, ctx=1764
  IO depths    : 1=0.1%, 2=0.2%, 4=10.2%, 8=89.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.1%, 4=0.2%, 10=3.3%, 20=10.6%, 50=22.4%, 100=23.2%
     lat (msec): 250=32.6%, 500=6.4%, 750=0.1%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=30688
  read : io=100MiB, bw=3,995KiB/s, runt= 26243msec
    slat (msec): min=    0, max= 5534, avg=837.43, stdev=1604.62
    clat (msec): min=    1, max=  362, avg=91.86, stdev=74.86
    bw (KiB/s) : min=   14, max= 9464, per=37.04%, avg=4391.56, stdev=2413.60
  write: io=26,024KiB, bw=1,283KiB/s, runt= 20756msec
    slat (msec): min=    0, max=    2, avg= 0.05, stdev= 0.24
    clat (msec): min=    1, max=  850, avg=123.31, stdev=119.37
    bw (KiB/s) : min=    0, max= 6895, per=67.67%, avg=2384.53, stdev=2082.61
  cpu          : usr=3.46%, sys=0.26%, ctx=1743
  IO depths    : 1=0.1%, 2=0.2%, 4=10.3%, 8=89.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.2%, 4=0.2%, 10=2.1%, 20=9.3%, 50=22.3%, 100=29.7%
     lat (msec): 250=29.9%, 500=5.7%, 750=0.2%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=30689
  read : io=100MiB, bw=3,951KiB/s, runt= 26535msec
    slat (msec): min=    0, max= 5212, avg=1006.77, stdev=1727.49
    clat (msec): min=    2, max=  717, avg=93.02, stdev=79.92
    bw (KiB/s) : min=   95, max= 9538, per=36.96%, avg=4381.88, stdev=2343.06
  write: io=27,324KiB, bw=1,308KiB/s, runt= 21375msec
    slat (msec): min=    0, max=    5, avg= 0.06, stdev= 0.36
    clat (msec): min=    0, max=  952, avg=102.73, stdev=115.75
    bw (KiB/s) : min=    0, max= 6159, per=73.75%, avg=2598.79, stdev=2155.85
  cpu          : usr=3.54%, sys=0.26%, ctx=1827
  IO depths    : 1=0.1%, 2=0.3%, 4=11.2%, 8=88.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.9%, 4=0.6%, 10=3.2%, 20=8.4%, 50=24.7%, 100=26.5%
     lat (msec): 250=30.3%, 500=4.6%, 750=0.5%, 1000=0.1%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,855KiB/s, minb=3,951KiB/s, maxb=4,031KiB/s, mint=26012msec, maxt=26535msec
  WRITE: io=75,180KiB, aggrb=3,524KiB/s, minb=1,023KiB/s, maxb=1,308KiB/s, mint=26012msec, maxt=26535msec

Disk stats (read/write):
  sda: ios=5127/1425, merge=1381/305, ticks=521764/178124, in_queue=699884, util=99.40%
2.86user 0.22system 0:26.80elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2383minor)pagefaults 0swaps