fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [12.0% done] [ 15772/  4260 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [16.0% done] [ 13532/  6260 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [19.2% done] [  9828/  9356 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [24.0% done] [ 10964/  5316 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [28.0% done] [  9988/  6708 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [32.0% done] [ 11144/  3500 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [33.3% done] [  8976/  4876 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [37.0% done] [ 12616/  2344 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [39.3% done] [  9048/  5600 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [41.4% done] [  7276/  6452 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [46.4% done] [  8828/  5308 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [48.3% done] [  8024/  4328 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [51.7% done] [  8156/  3460 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [53.3% done] [  8456/  3192 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [56.7% done] [  5280/  5504 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [58.1% done] [  6692/  4508 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [61.3% done] [  6692/  2944 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [62.5% done] [ 10060/     0 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [65.6% done] [  4952/  4644 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [68.8% done] [  8096/  4004 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.9% done] [ 19116/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [77.4% done] [ 19948/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [80.6% done] [ 19100/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [83.9% done] [ 19820/     0 kb/s] [eta 00m:05s]
Threads: 2: [V_V] [90.0% done] [ 16416/     0 kb/s] [eta 00m:03s]
fio: (groupid=0): err= 0: pid=26470
  read : io=100MiB, bw=3,765KiB/s, runt= 27848msec
    slat (msec): min=    0, max= 6073, avg=1577.60, stdev=2098.03
    clat (msec): min=    0, max=  426, avg=88.78, stdev=83.66
    bw (KiB/s) : min=   52, max=10057, per=37.85%, avg=4275.60, stdev=2772.32
  write: io=39,928KiB, bw=1,871KiB/s, runt= 21849msec
    slat (msec): min=    0, max=    3, avg= 0.05, stdev= 0.26
    clat (msec): min=    0, max=  974, avg=96.93, stdev=118.43
    bw (KiB/s) : min=    0, max=10800, per=52.18%, avg=2622.89, stdev=2267.35
  cpu          : usr=3.43%, sys=0.34%, ctx=1838
  IO depths    : 1=0.2%, 2=0.5%, 4=15.9%, 8=83.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.0%, 4=0.8%, 10=6.7%, 20=15.0%, 50=20.9%, 100=21.1%
     lat (msec): 250=27.4%, 500=6.4%, 750=0.4%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=26471
  read : io=100MiB, bw=3,929KiB/s, runt= 26685msec
    slat (msec): min=    0, max= 5975, avg=926.86, stdev=1707.02
    clat (msec): min=    3, max=  565, avg=88.01, stdev=74.08
    bw (KiB/s) : min=    3, max=10024, per=38.05%, avg=4297.75, stdev=2664.72
  write: io=33,260KiB, bw=1,645KiB/s, runt= 20698msec
    slat (msec): min=    0, max=   12, avg= 0.20, stdev= 1.12
    clat (msec): min=    0, max=  872, avg=124.99, stdev=127.28
    bw (KiB/s) : min=    0, max= 8012, per=52.15%, avg=2621.77, stdev=2470.49
  cpu          : usr=3.39%, sys=0.19%, ctx=1827
  IO depths    : 1=0.1%, 2=0.2%, 4=9.4%, 8=90.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.9%, 4=0.4%, 10=2.5%, 20=8.5%, 50=24.0%, 100=27.8%
     lat (msec): 250=29.8%, 500=5.3%, 750=0.4%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=26472
  read : io=100MiB, bw=3,785KiB/s, runt= 27700msec
    slat (msec): min=    0, max= 6483, avg=1365.56, stdev=2142.71
    clat (msec): min=    1, max=  635, avg=95.61, stdev=84.48
    bw (KiB/s) : min=   85, max= 9347, per=35.73%, avg=4035.64, stdev=2410.71
  write: io=34,084KiB, bw=1,600KiB/s, runt= 21813msec
    slat (msec): min=    0, max=    5, avg= 0.07, stdev= 0.37
    clat (msec): min=    0, max= 1056, avg=109.01, stdev=117.68
    bw (KiB/s) : min=    0, max= 5540, per=45.91%, avg=2307.75, stdev=1632.29
  cpu          : usr=3.64%, sys=0.17%, ctx=1795
  IO depths    : 1=0.1%, 2=0.2%, 4=13.3%, 8=86.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.4%, 4=0.1%, 10=2.9%, 20=10.1%, 50=21.9%, 100=27.7%
     lat (msec): 250=29.4%, 500=6.7%, 750=0.5%, 1000=0.1%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,296KiB/s, minb=3,765KiB/s, maxb=3,929KiB/s, mint=26685msec, maxt=27848msec
  WRITE: io=105MiB, aggrb=5,027KiB/s, minb=1,600KiB/s, maxb=1,871KiB/s, mint=26685msec, maxt=27848msec

Disk stats (read/write):
  sda: ios=4942/1918, merge=1366/413, ticks=472368/230888, in_queue=703256, util=99.49%
2.92user 0.32system 0:28.08elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2393minor)pagefaults 0swaps