fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.5% done] [  7324/ 11544 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [16.7% done] [ 17912/   924 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [20.0% done] [  8316/  9816 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [24.0% done] [ 10440/  6540 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [28.0% done] [ 11136/  5620 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [30.8% done] [  8936/  4672 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [34.6% done] [ 12596/  3376 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [38.5% done] [ 12448/  3448 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [42.3% done] [  2344/ 11804 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [42.9% done] [  3908/ 10480 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [46.4% done] [  6044/  7584 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [50.0% done] [  6212/  6288 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [51.7% done] [ 10744/   832 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [55.2% done] [  8664/  2272 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [56.7% done] [  9832/  1652 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [60.0% done] [  3308/  6424 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [61.3% done] [  4664/  5036 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [62.5% done] [  9612/   148 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [65.6% done] [  9680/   104 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [68.8% done] [ 10688/     0 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [69.7% done] [ 19456/     0 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [75.0% done] [ 19016/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [78.1% done] [ 18592/     0 kb/s] [eta 00m:07s]
Threads: 2: [V_V] [83.9% done] [ 21279/     0 kb/s] [eta 00m:05s]
fio: (groupid=0): err= 0: pid=21654
  read : io=100MiB, bw=3,836KiB/s, runt= 27330msec
    slat (msec): min=    0, max= 5727, avg=1208.09, stdev=1877.33
    clat (msec): min=    3, max=  884, avg=91.03, stdev=101.61
    bw (KiB/s) : min=   20, max=11912, per=36.90%, avg=4247.44, stdev=2712.75
  write: io=33,672KiB, bw=1,591KiB/s, runt= 21666msec
    slat (msec): min=    0, max=   10, avg= 0.13, stdev= 0.74
    clat (msec): min=    0, max=  966, avg=122.60, stdev=133.80
    bw (KiB/s) : min=    0, max= 6130, per=57.05%, avg=2722.35, stdev=1999.98
  cpu          : usr=3.21%, sys=0.28%, ctx=1767
  IO depths    : 1=0.1%, 2=0.2%, 4=13.5%, 8=86.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.4%, 4=0.5%, 10=4.4%, 20=14.1%, 50=21.6%, 100=24.4%
     lat (msec): 250=27.0%, 500=6.3%, 750=0.8%, 1000=0.5%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=21655
  read : io=100MiB, bw=3,980KiB/s, runt= 26340msec
    slat (msec): min=    0, max= 6303, avg=1198.84, stdev=1900.95
    clat (msec): min=    0, max=  688, avg=86.08, stdev=77.99
    bw (KiB/s) : min=   76, max=13007, per=41.31%, avg=4754.39, stdev=2740.62
  write: io=30,336KiB, bw=1,516KiB/s, runt= 20479msec
    slat (msec): min=    0, max=    2, avg= 0.07, stdev= 0.32
    clat (msec): min=    0, max=  821, avg=112.78, stdev=99.07
    bw (KiB/s) : min=    0, max= 6603, per=53.17%, avg=2537.30, stdev=1918.72
  cpu          : usr=3.28%, sys=0.23%, ctx=1768
  IO depths    : 1=0.1%, 2=0.4%, 4=12.9%, 8=86.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.4%, 4=0.7%, 10=3.5%, 20=10.7%, 50=22.1%, 100=27.3%
     lat (msec): 250=30.2%, 500=4.5%, 750=0.4%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=21656
  read : io=100MiB, bw=3,867KiB/s, runt= 27112msec
    slat (msec): min=    0, max= 5808, avg=1001.94, stdev=1745.95
    clat (msec): min=    1, max=  790, avg=90.97, stdev=80.24
    bw (KiB/s) : min=   20, max=10328, per=37.57%, avg=4324.40, stdev=2503.57
  write: io=36,972KiB, bw=1,776KiB/s, runt= 21314msec
    slat (msec): min=    0, max=    3, avg= 0.10, stdev= 0.42
    clat (msec): min=    0, max=  932, avg=113.31, stdev=102.32
    bw (KiB/s) : min=    0, max= 8674, per=69.84%, avg=3332.70, stdev=2679.87
  cpu          : usr=3.57%, sys=0.22%, ctx=1847
  IO depths    : 1=0.1%, 2=0.3%, 4=12.0%, 8=87.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.3%, 4=0.4%, 10=2.0%, 20=10.2%, 50=22.3%, 100=28.8%
     lat (msec): 250=31.0%, 500=4.6%, 750=0.1%, 1000=0.2%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,510KiB/s, minb=3,836KiB/s, maxb=3,980KiB/s, mint=26340msec, maxt=27330msec
  WRITE: io=99MiB, aggrb=4,772KiB/s, minb=1,516KiB/s, maxb=1,776KiB/s, mint=26340msec, maxt=27330msec

Disk stats (read/write):
  sda: ios=4980/1734, merge=1310/275, ticks=448748/220236, in_queue=668988, util=99.52%
2.76user 0.21system 0:27.61elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2401minor)pagefaults 0swaps