fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [12.0% done] [ 14392/  5528 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [16.0% done] [ 16952/  3868 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [19.2% done] [ 12512/  4884 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [22.2% done] [ 16372/     0 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [25.9% done] [ 10292/  5496 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [28.6% done] [  9696/  4084 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [32.1% done] [ 12212/  2844 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [33.3% done] [ 12148/  3480 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [37.9% done] [  4756/ 10916 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [40.0% done] [  9176/  4968 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [44.8% done] [ 11544/  2340 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [48.3% done] [ 12952/   512 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [51.7% done] [  5488/  6156 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [53.3% done] [  7132/  4360 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [56.7% done] [  7620/  3012 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [58.1% done] [  5764/  5856 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [59.4% done] [  4360/  5516 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [60.6% done] [  6848/  1220 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [65.6% done] [  6248/  3332 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [68.8% done] [  7428/  4236 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.9% done] [ 18536/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [75.0% done] [ 17424/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [80.6% done] [ 16844/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [83.9% done] [ 18164/     0 kb/s] [eta 00m:05s]
fio: (groupid=0): err= 0: pid=982
  read : io=100MiB, bw=3,853KiB/s, runt= 27209msec
    slat (msec): min=    0, max= 5338, avg=979.43, stdev=1619.28
    clat (msec): min=    2, max=  864, avg=94.56, stdev=98.65
    bw (KiB/s) : min=  305, max=10733, per=35.93%, avg=4130.36, stdev=2320.86
  write: io=32,840KiB, bw=1,538KiB/s, runt= 21860msec
    slat (msec): min=    0, max=    3, avg= 0.07, stdev= 0.32
    clat (msec): min=    0, max=  924, avg=86.57, stdev=108.02
    bw (KiB/s) : min=    0, max= 6531, per=60.18%, avg=2546.85, stdev=2250.88
  cpu          : usr=3.35%, sys=0.15%, ctx=1850
  IO depths    : 1=0.1%, 2=0.2%, 4=13.3%, 8=86.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.6%, 4=0.6%, 10=5.3%, 20=14.7%, 50=24.7%, 100=16.9%
     lat (msec): 250=28.7%, 500=6.5%, 750=0.6%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=983
  read : io=100MiB, bw=3,957KiB/s, runt= 26498msec
    slat (msec): min=    0, max= 6192, avg=1252.73, stdev=2008.88
    clat (msec): min=    2, max=  492, avg=92.95, stdev=76.18
    bw (KiB/s) : min=    6, max=10293, per=37.84%, avg=4349.63, stdev=2564.03
  write: io=25,680KiB, bw=1,295KiB/s, runt= 20304msec
    slat (msec): min=    0, max=    2, avg= 0.05, stdev= 0.26
    clat (msec): min=    0, max=  977, avg=95.49, stdev=105.82
    bw (KiB/s) : min=    0, max= 6574, per=51.96%, avg=2198.85, stdev=1982.32
  cpu          : usr=3.29%, sys=0.23%, ctx=1735
  IO depths    : 1=0.2%, 2=0.3%, 4=12.9%, 8=86.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.6%, 4=0.5%, 10=3.0%, 20=11.5%, 50=22.7%, 100=23.1%
     lat (msec): 250=33.5%, 500=4.6%, 750=0.2%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=984
  read : io=100MiB, bw=3,832KiB/s, runt= 27362msec
    slat (msec): min=    0, max= 6628, avg=1648.13, stdev=2348.48
    clat (msec): min=    1, max=  603, avg=94.32, stdev=80.58
    bw (KiB/s) : min=   22, max= 9301, per=37.12%, avg=4266.93, stdev=2503.80
  write: io=31,828KiB, bw=1,503KiB/s, runt= 21672msec
    slat (msec): min=    0, max=    4, avg= 0.05, stdev= 0.30
    clat (msec): min=    0, max= 1164, avg=101.63, stdev=131.81
    bw (KiB/s) : min=    0, max= 5375, per=50.84%, avg=2151.57, stdev=1696.97
  cpu          : usr=3.16%, sys=0.13%, ctx=1787
  IO depths    : 1=0.1%, 2=0.2%, 4=13.9%, 8=85.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.3%, 4=0.6%, 10=3.4%, 20=12.0%, 50=23.1%, 100=21.4%
     lat (msec): 250=31.8%, 500=5.7%, 750=0.1%, 1000=0.3%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,496KiB/s, minb=3,832KiB/s, maxb=3,957KiB/s, mint=26498msec, maxt=27362msec
  WRITE: io=90,348KiB, aggrb=4,232KiB/s, minb=1,295KiB/s, maxb=1,538KiB/s, mint=26498msec, maxt=27362msec

Disk stats (read/write):
  sda: ios=4956/1781, merge=1398/262, ticks=482304/186088, in_queue=668384, util=99.52%
2.70user 0.22system 0:27.60elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2391minor)pagefaults 0swaps