fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [10.0% done] [ 13276/  7321 kb/s] [eta 00m:27s]
Threads: 3: [mmm] [13.3% done] [  8459/  9724 kb/s] [eta 00m:26s]
Threads: 3: [mmm] [17.2% done] [ 11760/  6419 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [21.4% done] [ 10870/  6774 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [25.0% done] [  9113/  6132 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [28.6% done] [  9519/  5352 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [32.1% done] [ 11137/  3012 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [35.7% done] [ 15214/   126 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [39.3% done] [ 13335/  1457 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [42.9% done] [ 12756/  1957 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [44.8% done] [  6766/  5876 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [48.3% done] [  8952/  3749 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [51.7% done] [  7727/  3186 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [53.3% done] [  8566/  2575 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [56.7% done] [  6336/  4891 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [58.1% done] [  6348/  3966 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [61.3% done] [  6809/  3540 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [62.5% done] [  7550/  2237 kb/s] [eta 00m:12s]
Threads: 3: [VVV] [67.7% done] [  6951/  1898 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.0% done] [ 18491/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [74.2% done] [ 18550/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [80.0% done] [ 19940/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [83.3% done] [ 19940/     0 kb/s] [eta 00m:05s]
Threads: 1: [__V] [93.1% done] [ 18266/     0 kb/s] [eta 00m:02s]
fio: (groupid=0): err= 0: pid=2556
  read : io=100MiB, bw=3,956KiB/s, runt= 26504msec
    slat (msec): min=    0, max= 4927, avg=786.32, stdev=1444.47
    clat (msec): min=    2, max=  849, avg=91.90, stdev=91.26
    bw (KiB/s) : min=    4, max= 8721, per=35.56%, avg=4130.93, stdev=2325.72
  write: io=28,672KiB, bw=1,359KiB/s, runt= 21593msec
    slat (msec): min=    0, max=    5, avg= 0.09, stdev= 0.47
    clat (msec): min=    0, max=  894, avg=124.77, stdev=177.32
    bw (KiB/s) : min=    0, max= 5982, per=42.71%, avg=2031.17, stdev=1840.97
  cpu          : usr=3.38%, sys=0.21%, ctx=1743
  IO depths    : 1=0.1%, 2=0.2%, 4=11.8%, 8=87.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.8%, 4=0.5%, 10=5.5%, 20=15.6%, 50=22.4%, 100=20.6%
     lat (msec): 250=25.0%, 500=8.2%, 750=0.6%, 1000=0.8%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2557
  read : io=100MiB, bw=4,011KiB/s, runt= 26139msec
    slat (msec): min=    0, max= 5880, avg=932.30, stdev=1714.27
    clat (msec): min=    3, max=  401, avg=87.16, stdev=72.33
    bw (KiB/s) : min=   93, max=10797, per=38.42%, avg=4462.74, stdev=2711.50
  write: io=30,916KiB, bw=1,557KiB/s, runt= 20323msec
    slat (msec): min=    0, max=    5, avg= 0.11, stdev= 0.46
    clat (msec): min=    0, max=  833, avg=118.87, stdev=115.49
    bw (KiB/s) : min=    0, max= 6188, per=52.22%, avg=2483.79, stdev=1895.14
  cpu          : usr=3.63%, sys=0.32%, ctx=1773
  IO depths    : 1=0.1%, 2=0.2%, 4=10.9%, 8=88.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.7%, 4=0.3%, 10=3.1%, 20=10.6%, 50=23.3%, 100=26.2%
     lat (msec): 250=29.9%, 500=5.5%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2558
  read : io=100MiB, bw=3,872KiB/s, runt= 27080msec
    slat (msec): min=    0, max= 6395, avg=1687.63, stdev=2356.20
    clat (msec): min=    1, max=  739, avg=88.82, stdev=82.69
    bw (KiB/s) : min=   62, max=18802, per=38.60%, avg=4483.59, stdev=3480.19
  write: io=40,708KiB, bw=2,015KiB/s, runt= 20682msec
    slat (msec): min=    0, max=    7, avg= 0.12, stdev= 0.67
    clat (msec): min=    0, max=  894, avg=111.11, stdev=120.70
    bw (KiB/s) : min=    0, max=11065, per=64.05%, avg=3046.00, stdev=2753.25
  cpu          : usr=3.57%, sys=0.31%, ctx=1799
  IO depths    : 1=0.1%, 2=0.2%, 4=12.7%, 8=86.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.3%, 4=0.6%, 10=3.6%, 20=11.3%, 50=24.0%, 100=25.1%
     lat (msec): 250=26.4%, 500=6.8%, 750=0.6%, 1000=0.1%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,616KiB/s, minb=3,872KiB/s, maxb=4,011KiB/s, mint=26139msec, maxt=27080msec
  WRITE: io=98MiB, aggrb=4,756KiB/s, minb=1,359KiB/s, maxb=2,015KiB/s, mint=26139msec, maxt=27080msec

Disk stats (read/write):
  sda: ios=4954/1687, merge=1604/355, ticks=464200/366028, in_queue=830228, util=99.25%
2.86user 0.25system 0:27.46elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2388minor)pagefaults 0swaps