fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [13.6% done] [ 20912/  5036 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [18.2% done] [ 18890/  3343 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [22.7% done] [  8677/ 14862 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [27.3% done] [ 12932/  8356 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [31.8% done] [ 16828/  3808 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [38.1% done] [ 17088/  1996 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [42.9% done] [ 14228/  4904 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [45.5% done] [  5732/ 12068 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [50.0% done] [ 10324/  5788 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [52.2% done] [  2840/ 11880 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [56.5% done] [ 11028/  2160 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [58.3% done] [  9148/  3324 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [60.0% done] [  9176/  2068 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [64.0% done] [  3644/  6692 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [65.4% done] [  5864/  2636 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [69.2% done] [ 17752/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [76.0% done] [ 20780/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 21336/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.0% done] [ 19848/     0 kb/s] [eta 00m:04s]
Threads: 2: [_VV] [91.7% done] [ 19788/     0 kb/s] [eta 00m:02s]
fio: (groupid=0): err= 0: pid=25985
  read : io=100MiB, bw=4,728KiB/s, runt= 22176msec
    slat (msec): min=    0, max= 4738, avg=742.61, stdev=1359.01
    clat (msec): min=    0, max=  751, avg=80.60, stdev=72.25
    bw (KiB/s) : min=   52, max= 8880, per=36.06%, avg=5024.26, stdev=2670.87
  write: io=27,132KiB, bw=1,575KiB/s, runt= 17638msec
    slat (msec): min=    0, max=    2, avg= 0.04, stdev= 0.24
    clat (msec): min=    0, max=  832, avg=76.71, stdev=78.98
    bw (KiB/s) : min=    0, max= 6960, per=55.39%, avg=3210.25, stdev=2850.38
  cpu          : usr=4.02%, sys=0.23%, ctx=1851
  IO depths    : 1=0.1%, 2=0.2%, 4=11.0%, 8=88.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.4%, 4=0.6%, 10=3.2%, 20=12.1%, 50=28.2%, 100=27.8%
     lat (msec): 250=24.3%, 500=3.1%, 750=0.0%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25986
  read : io=100MiB, bw=4,645KiB/s, runt= 22572msec
    slat (msec): min=    0, max= 7002, avg=1585.66, stdev=2374.09
    clat (msec): min=    1, max=  422, avg=74.14, stdev=63.40
    bw (KiB/s) : min=   12, max=12550, per=38.66%, avg=5386.82, stdev=2915.66
  write: io=34,660KiB, bw=2,248KiB/s, runt= 15785msec
    slat (msec): min=    0, max=    4, avg= 0.04, stdev= 0.25
    clat (msec): min=    0, max=  915, avg=75.11, stdev=83.42
    bw (KiB/s) : min=    0, max=10833, per=63.96%, avg=3707.12, stdev=3741.09
  cpu          : usr=4.20%, sys=0.37%, ctx=1804
  IO depths    : 1=0.2%, 2=0.3%, 4=12.5%, 8=87.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.2%, 4=1.0%, 10=3.6%, 20=11.6%, 50=28.0%, 100=30.9%
     lat (msec): 250=21.1%, 500=2.4%, 750=0.1%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25987
  read : io=100MiB, bw=4,644KiB/s, runt= 22576msec
    slat (msec): min=    0, max= 4990, avg=958.76, stdev=1556.98
    clat (msec): min=    0, max=  365, avg=73.61, stdev=68.74
    bw (KiB/s) : min=   45, max= 9707, per=36.73%, avg=5118.08, stdev=2774.53
  write: io=38,044KiB, bw=2,211KiB/s, runt= 17613msec
    slat (msec): min=    0, max=    5, avg= 0.08, stdev= 0.37
    clat (msec): min=    0, max=  623, avg=80.56, stdev=81.62
    bw (KiB/s) : min=    0, max= 7800, per=65.67%, avg=3806.37, stdev=2731.08
  cpu          : usr=4.00%, sys=0.34%, ctx=1904
  IO depths    : 1=0.2%, 2=0.3%, 4=14.2%, 8=85.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.6%, 4=0.6%, 10=4.9%, 20=14.2%, 50=27.3%, 100=27.2%
     lat (msec): 250=21.8%, 500=3.2%, 750=0.2%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,933KiB/s, minb=4,644KiB/s, maxb=4,728KiB/s, mint=22176msec, maxt=22576msec
  WRITE: io=99,836KiB, aggrb=5,796KiB/s, minb=1,575KiB/s, maxb=2,248KiB/s, mint=22176msec, maxt=22576msec

Disk stats (read/write):
  sda: ios=4685/1673, merge=1512/441, ticks=356744/158112, in_queue=514852, util=99.27%
2.80user 0.22system 0:22.83elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2383minor)pagefaults 0swaps