fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [10.7% done] [  8617/  9980 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [16.7% done] [ 19609/  1350 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [20.8% done] [  9397/  9145 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [24.0% done] [  6711/ 10137 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [28.0% done] [  9516/  7612 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [30.8% done] [  8156/  6951 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [34.6% done] [  9716/  5427 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [38.5% done] [  8050/  6529 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [42.3% done] [  9255/  4895 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [44.4% done] [  7337/  7624 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [48.1% done] [  6959/  5884 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [50.0% done] [  5498/  6986 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [53.6% done] [  7652/  4584 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [55.2% done] [  5873/  5578 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [58.6% done] [  6565/  3158 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [60.0% done] [  6392/  3469 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [63.3% done] [  6801/  2717 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [64.5% done] [  5655/  3111 kb/s] [eta 00m:11s]
Threads: 3: [mVm] [65.6% done] [ 11033/  1770 kb/s] [eta 00m:11s]
Threads: 3: [mVm] [66.7% done] [  9844/  2936 kb/s] [eta 00m:11s]
Threads: 3: [mVm] [67.6% done] [ 18788/   132 kb/s] [eta 00m:11s]
Threads: 2: [V_V] [68.6% done] [ 18952/     0 kb/s] [eta 00m:11s]
Threads: 2: [V_V] [75.8% done] [ 17452/     0 kb/s] [eta 00m:08s]
Threads: 2: [V_V] [81.2% done] [ 19276/     0 kb/s] [eta 00m:06s]
Threads: 2: [V_V] [87.1% done] [ 19244/     0 kb/s] [eta 00m:04s]
fio: (groupid=0): err= 0: pid=10007
  read : io=100MiB, bw=3,650KiB/s, runt= 28723msec
    slat (msec): min=    0, max= 6901, avg=2109.77, stdev=2334.42
    clat (msec): min=    0, max=  551, avg=75.32, stdev=72.71
    bw (KiB/s) : min=   22, max=16215, per=44.04%, avg=4823.22, stdev=4418.22
  write: io=45,896KiB, bw=2,063KiB/s, runt= 22781msec
    slat (msec): min=    0, max=    9, avg= 0.07, stdev= 0.52
    clat (msec): min=    0, max= 1001, avg=111.52, stdev=128.71
    bw (KiB/s) : min=    0, max= 9426, per=46.77%, avg=2592.65, stdev=1996.91
  cpu          : usr=3.44%, sys=0.36%, ctx=1878
  IO depths    : 1=0.1%, 2=0.3%, 4=16.1%, 8=83.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.8%, 4=1.1%, 10=5.8%, 20=14.8%, 50=20.5%, 100=23.9%
     lat (msec): 250=26.4%, 500=4.6%, 750=0.7%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=10008
  read : io=100MiB, bw=4,308KiB/s, runt= 24340msec
    slat (msec): min=    0, max= 3344, avg=747.88, stdev=1098.52
    clat (msec): min=    0, max=  806, avg=72.04, stdev=72.60
    bw (KiB/s) : min=  110, max=20750, per=43.50%, avg=4763.43, stdev=4539.40
  write: io=45,316KiB, bw=2,202KiB/s, runt= 21071msec
    slat (msec): min=    0, max=    2, avg= 0.07, stdev= 0.27
    clat (msec): min=    0, max=  656, avg=109.51, stdev=93.64
    bw (KiB/s) : min=    0, max= 7458, per=58.99%, avg=3269.56, stdev=2286.11
  cpu          : usr=3.57%, sys=0.16%, ctx=1822
  IO depths    : 1=0.1%, 2=0.2%, 4=14.9%, 8=84.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.3%, 4=0.2%, 10=3.7%, 20=12.2%, 50=27.4%, 100=27.2%
     lat (msec): 250=24.4%, 500=3.8%, 750=0.5%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=10009
  read : io=100MiB, bw=3,728KiB/s, runt= 28121msec
    slat (msec): min=    0, max= 5778, avg=1166.60, stdev=1877.09
    clat (msec): min=    1, max=  454, avg=89.14, stdev=66.45
    bw (KiB/s) : min=   53, max=10963, per=39.48%, avg=4323.07, stdev=2871.25
  write: io=32,120KiB, bw=1,446KiB/s, runt= 22738msec
    slat (msec): min=    0, max=    9, avg= 0.11, stdev= 0.75
    clat (msec): min=    0, max=  976, avg=118.45, stdev=145.69
    bw (KiB/s) : min=    0, max= 5238, per=39.95%, avg=2214.25, stdev=2047.29
  cpu          : usr=3.58%, sys=0.27%, ctx=1835
  IO depths    : 1=0.1%, 2=0.2%, 4=10.7%, 8=88.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.8%, 4=0.3%, 10=3.0%, 20=10.4%, 50=19.7%, 100=26.7%
     lat (msec): 250=35.1%, 500=3.2%, 750=0.2%, 1000=0.5%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=10,951KiB/s, minb=3,650KiB/s, maxb=4,308KiB/s, mint=24340msec, maxt=28723msec
  WRITE: io=120MiB, aggrb=5,543KiB/s, minb=1,446KiB/s, maxb=2,202KiB/s, mint=24340msec, maxt=28723msec

Disk stats (read/write):
  sda: ios=4969/2154, merge=1458/517, ticks=410444/262832, in_queue=673280, util=99.53%
2.90user 0.32system 0:29.02elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2399minor)pagefaults 0swaps