fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [9.4% done] [ 10396/  8672 kb/s] [eta 00m:29s]
Threads: 3: [mmm] [14.3% done] [  4228/ 16508 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [17.9% done] [ 13452/  4796 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [21.4% done] [  9636/  6816 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [25.0% done] [  9696/  4608 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [27.6% done] [ 10252/  5832 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [32.1% done] [ 10872/  4760 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [35.7% done] [ 10232/  4448 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [37.9% done] [  8756/  6800 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [41.4% done] [  8600/  5996 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [43.3% done] [ 11356/  2140 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [46.7% done] [  7992/  4048 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [50.0% done] [ 10192/  2604 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [51.6% done] [  5680/  5352 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [54.8% done] [  8072/  2084 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [56.2% done] [  5656/  5068 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [59.4% done] [  2988/  6700 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [60.6% done] [  8316/   964 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [63.6% done] [  4148/  4928 kb/s] [eta 00m:12s]
Threads: 3: [VVV] [68.8% done] [ 10276/   264 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.9% done] [ 21072/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [77.4% done] [ 19120/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [80.6% done] [ 18692/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [83.9% done] [ 19180/     0 kb/s] [eta 00m:05s]
Threads: 2: [_VV] [87.1% done] [ 17796/     0 kb/s] [eta 00m:04s]
fio: (groupid=0): err= 0: pid=13524
  read : io=100MiB, bw=3,846KiB/s, runt= 27257msec
    slat (msec): min=    0, max= 5155, avg=801.23, stdev=1434.50
    clat (msec): min=    4, max=  474, avg=89.65, stdev=80.62
    bw (KiB/s) : min=   90, max=10538, per=38.12%, avg=4301.97, stdev=2604.32
  write: io=36,556KiB, bw=1,697KiB/s, runt= 22054msec
    slat (msec): min=    0, max=    5, avg= 0.11, stdev= 0.49
    clat (msec): min=    0, max=  870, avg=126.58, stdev=148.38
    bw (KiB/s) : min=    0, max= 7997, per=52.92%, avg=2584.92, stdev=2268.99
  cpu          : usr=3.24%, sys=0.23%, ctx=1781
  IO depths    : 1=0.1%, 2=0.2%, 4=12.4%, 8=87.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.5%, 4=0.2%, 10=4.5%, 20=13.0%, 50=23.2%, 100=21.9%
     lat (msec): 250=29.1%, 500=6.5%, 750=0.6%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13525
  read : io=100MiB, bw=3,775KiB/s, runt= 27772msec
    slat (msec): min=    0, max= 7474, avg=1726.13, stdev=2492.95
    clat (msec): min=    2, max=  485, avg=87.65, stdev=75.89
    bw (KiB/s) : min=   68, max=10212, per=40.49%, avg=4568.45, stdev=2515.07
  write: io=35,452KiB, bw=1,735KiB/s, runt= 20913msec
    slat (msec): min=    0, max=    3, avg= 0.07, stdev= 0.33
    clat (msec): min=    0, max=  726, avg=95.24, stdev=91.39
    bw (KiB/s) : min=    0, max= 7646, per=64.64%, avg=3157.71, stdev=2517.30
  cpu          : usr=3.41%, sys=0.14%, ctx=1850
  IO depths    : 1=0.1%, 2=0.2%, 4=15.7%, 8=84.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.7%, 4=0.6%, 10=3.9%, 20=11.6%, 50=22.5%, 100=26.5%
     lat (msec): 250=28.5%, 500=5.5%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13526
  read : io=100MiB, bw=3,761KiB/s, runt= 27876msec
    slat (msec): min=    0, max= 6507, avg=1225.53, stdev=1955.48
    clat (msec): min=    3, max=  487, avg=94.00, stdev=77.17
    bw (KiB/s) : min=   17, max=11031, per=36.47%, avg=4114.89, stdev=2681.00
  write: io=33,212KiB, bw=1,585KiB/s, runt= 21448msec
    slat (msec): min=    0, max=    3, avg= 0.04, stdev= 0.27
    clat (msec): min=    0, max=  857, avg=103.89, stdev=96.52
    bw (KiB/s) : min=    0, max= 4657, per=53.50%, avg=2613.33, stdev=1739.41
  cpu          : usr=3.53%, sys=0.23%, ctx=1853
  IO depths    : 1=0.1%, 2=0.2%, 4=12.1%, 8=87.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.4%, 4=0.3%, 10=3.0%, 20=8.8%, 50=22.4%, 100=26.5%
     lat (msec): 250=32.4%, 500=5.9%, 750=0.2%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,284KiB/s, minb=3,761KiB/s, maxb=3,846KiB/s, mint=27257msec, maxt=27876msec
  WRITE: io=103MiB, aggrb=4,885KiB/s, minb=1,585KiB/s, maxb=1,735KiB/s, mint=27257msec, maxt=27876msec

Disk stats (read/write):
  sda: ios=5023/1802, merge=1405/317, ticks=466244/212176, in_queue=678420, util=99.48%
2.87user 0.23system 0:28.17elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2387minor)pagefaults 0swaps