fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [15.8% done] [ 13926/  9728 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [22.2% done] [ 15749/  8975 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [26.3% done] [ 18061/  4848 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [31.6% done] [ 11972/ 10586 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [35.0% done] [ 11275/  9011 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [40.0% done] [ 12059/  7388 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [45.0% done] [ 11980/  6896 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [47.6% done] [  7388/  8522 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [52.4% done] [  8345/  7510 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [54.5% done] [ 12508/  2567 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [56.5% done] [ 10531/  2721 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [60.9% done] [  9834/  2693 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [62.5% done] [  3288/  8109 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [64.0% done] [  4781/  4923 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [70.8% done] [ 11145/  4812 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [75.0% done] [ 21787/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [79.2% done] [ 20988/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [83.3% done] [ 21539/     0 kb/s] [eta 00m:04s]
Threads: 2: [_VV] [91.3% done] [ 21058/     0 kb/s] [eta 00m:02s]
Threads: 1: [__V] [100.0% done] [ 22996/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=24820
  read : io=100MiB, bw=4,875KiB/s, runt= 21508msec
    slat (msec): min=    0, max= 4964, avg=838.76, stdev=1460.81
    clat (msec): min=    0, max=  377, avg=75.94, stdev=66.05
    bw (KiB/s) : min=  158, max=11131, per=38.75%, avg=5339.29, stdev=2915.45
  write: io=29,808KiB, bw=1,844KiB/s, runt= 16544msec
    slat (msec): min=    0, max=    3, avg= 0.05, stdev= 0.27
    clat (msec): min=    0, max=  867, avg=91.31, stdev=109.07
    bw (KiB/s) : min=    0, max= 8293, per=39.32%, avg=2880.39, stdev=2887.62
  cpu          : usr=4.28%, sys=0.41%, ctx=1734
  IO depths    : 1=0.1%, 2=0.3%, 4=12.0%, 8=87.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.8%, 4=0.6%, 10=3.8%, 20=12.3%, 50=26.7%, 100=28.9%
     lat (msec): 250=23.1%, 500=3.5%, 750=0.2%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=24821
  read : io=100MiB, bw=4,695KiB/s, runt= 22333msec
    slat (msec): min=    0, max= 6879, avg=1880.42, stdev=2461.42
    clat (msec): min=    0, max=  524, avg=72.09, stdev=68.58
    bw (KiB/s) : min=   54, max=10946, per=39.26%, avg=5408.61, stdev=3103.08
  write: io=38,520KiB, bw=2,550KiB/s, runt= 15468msec
    slat (msec): min=    0, max=    4, avg= 0.06, stdev= 0.33
    clat (msec): min=    0, max=  685, avg=69.38, stdev=78.33
    bw (KiB/s) : min=    0, max= 9098, per=54.79%, avg=4013.72, stdev=3356.78
  cpu          : usr=3.90%, sys=0.32%, ctx=1786
  IO depths    : 1=0.1%, 2=0.2%, 4=15.8%, 8=83.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.4%, 4=1.1%, 10=5.2%, 20=14.9%, 50=27.7%, 100=26.5%
     lat (msec): 250=19.6%, 500=3.3%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=24822
  read : io=100MiB, bw=4,592KiB/s, runt= 22831msec
    slat (msec): min=    0, max= 5985, avg=2011.28, stdev=2282.33
    clat (msec): min=    0, max=  324, avg=64.28, stdev=67.38
    bw (KiB/s) : min=   48, max=17896, per=37.08%, avg=5108.97, stdev=4297.45
  write: io=54,228KiB, bw=3,241KiB/s, runt= 17130msec
    slat (msec): min=    0, max=    6, avg= 0.08, stdev= 0.44
    clat (msec): min=    0, max=  831, avg=85.25, stdev=104.92
    bw (KiB/s) : min=    0, max= 8790, per=46.15%, avg=3380.82, stdev=2709.67
  cpu          : usr=4.15%, sys=0.49%, ctx=1788
  IO depths    : 1=0.1%, 2=0.4%, 4=18.9%, 8=80.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.9%, 4=1.5%, 10=7.7%, 20=18.1%, 50=24.4%, 100=23.2%
     lat (msec): 250=18.1%, 500=4.6%, 750=0.3%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,778KiB/s, minb=4,592KiB/s, maxb=4,875KiB/s, mint=21508msec, maxt=22831msec
  WRITE: io=120MiB, aggrb=7,326KiB/s, minb=1,844KiB/s, maxb=3,241KiB/s, mint=21508msec, maxt=22831msec

Disk stats (read/write):
  sda: ios=4365/2000, merge=1639/523, ticks=304264/176208, in_queue=480480, util=99.03%
2.77user 0.38system 0:23.17elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2378minor)pagefaults 0swaps