fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [13.6% done] [ 13144/ 12704 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [18.2% done] [ 18148/  4984 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [22.7% done] [ 11920/ 10148 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [28.6% done] [ 15230/  6326 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [33.3% done] [  8648/ 11432 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [38.1% done] [  4036/ 16528 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [42.9% done] [ 13544/  5340 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [45.5% done] [ 10476/  7304 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [50.0% done] [ 12736/  2828 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [52.2% done] [ 12124/  1776 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [56.5% done] [  6820/  5972 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [58.3% done] [  5484/  7176 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [60.0% done] [  7992/  2992 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [64.0% done] [  8788/  2220 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [68.0% done] [  9188/   500 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 22936/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [79.2% done] [ 23338/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [83.3% done] [ 22420/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [87.5% done] [ 24008/     0 kb/s] [eta 00m:03s]
Threads: 2: [V_V] [95.7% done] [ 21940/     0 kb/s] [eta 00m:01s]
fio: (groupid=0): err= 0: pid=26841
  read : io=100MiB, bw=4,647KiB/s, runt= 22564msec
    slat (msec): min=    0, max= 5140, avg=1001.10, stdev=1588.84
    clat (msec): min=    0, max=  685, avg=70.73, stdev=75.43
    bw (KiB/s) : min=  115, max=11196, per=34.67%, avg=4727.19, stdev=3073.11
  write: io=41,832KiB, bw=2,471KiB/s, runt= 17329msec
    slat (msec): min=    0, max=    9, avg= 0.11, stdev= 0.71
    clat (msec): min=    0, max=  888, avg=99.61, stdev=115.47
    bw (KiB/s) : min=    0, max=10368, per=39.25%, avg=3005.60, stdev=2583.07
  cpu          : usr=4.43%, sys=0.34%, ctx=1793
  IO depths    : 1=0.1%, 2=0.3%, 4=14.8%, 8=84.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.1%, 4=0.7%, 10=4.2%, 20=14.1%, 50=29.7%, 100=25.2%
     lat (msec): 250=19.3%, 500=4.9%, 750=0.5%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=26842
  read : io=100MiB, bw=4,822KiB/s, runt= 21743msec
    slat (msec): min=    0, max= 6543, avg=1226.44, stdev=2051.08
    clat (msec): min=    0, max=  357, avg=71.96, stdev=65.51
    bw (KiB/s) : min=   33, max=10611, per=42.23%, avg=5758.12, stdev=3127.30
  write: io=33,912KiB, bw=2,274KiB/s, runt= 15270msec
    slat (msec): min=    0, max=    7, avg= 0.14, stdev= 0.67
    clat (msec): min=    0, max=  837, avg=84.08, stdev=106.95
    bw (KiB/s) : min=    0, max=10952, per=54.64%, avg=4184.00, stdev=3694.90
  cpu          : usr=4.38%, sys=0.37%, ctx=1760
  IO depths    : 1=0.1%, 2=0.2%, 4=11.4%, 8=88.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=2.1%, 4=1.0%, 10=3.3%, 20=11.5%, 50=29.1%, 100=29.5%
     lat (msec): 250=19.0%, 500=4.0%, 750=0.2%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=26843
  read : io=100MiB, bw=4,545KiB/s, runt= 23069msec
    slat (msec): min=    0, max= 6246, avg=1672.74, stdev=2198.48
    clat (msec): min=    2, max=  418, avg=65.38, stdev=68.75
    bw (KiB/s) : min=   35, max=15187, per=37.00%, avg=5044.88, stdev=3792.48
  write: io=53,836KiB, bw=3,269KiB/s, runt= 16861msec
    slat (msec): min=    0, max=    3, avg= 0.05, stdev= 0.30
    clat (msec): min=    0, max=  662, avg=90.48, stdev=94.51
    bw (KiB/s) : min=    0, max= 8764, per=54.46%, avg=4169.72, stdev=3266.48
  cpu          : usr=4.42%, sys=0.42%, ctx=1915
  IO depths    : 1=0.1%, 2=0.2%, 4=14.3%, 8=85.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.5%, 4=0.8%, 10=5.3%, 20=15.0%, 50=30.2%, 100=23.9%
     lat (msec): 250=18.3%, 500=4.6%, 750=0.3%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,636KiB/s, minb=4,545KiB/s, maxb=4,822KiB/s, mint=21743msec, maxt=23069msec
  WRITE: io=127MiB, aggrb=7,657KiB/s, minb=2,274KiB/s, maxb=3,269KiB/s, mint=21743msec, maxt=23069msec

Disk stats (read/write):
  sda: ios=4467/1829, merge=1610/392, ticks=308464/194592, in_queue=503056, util=99.41%
3.00user 0.36system 0:23.31elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2376minor)pagefaults 0swaps