fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [10.3% done] [ 14725/  3694 kb/s] [eta 00m:26s]
Threads: 3: [mmm] [14.8% done] [ 13786/  4695 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [18.5% done] [ 16943/   409 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [23.1% done] [ 12016/  5391 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [26.9% done] [ 10354/  6955 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [30.8% done] [  7136/  8534 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [34.6% done] [  7983/  7699 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [38.5% done] [ 12922/  1504 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [40.7% done] [ 11712/  3477 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [44.4% done] [ 11323/  2993 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [48.1% done] [  6841/  7321 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [50.0% done] [  4714/  8140 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [53.6% done] [  8763/  2772 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [55.2% done] [  8144/  2737 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [56.7% done] [  7483/  3308 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [60.0% done] [  4962/  4107 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [61.3% done] [  7262/  2512 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [64.5% done] [  6782/  2272 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [65.6% done] [  4084/  4671 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [68.8% done] [  6175/  3635 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.9% done] [ 20113/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [75.0% done] [ 18069/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [80.6% done] [ 17483/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.8% done] [ 13800/     0 kb/s] [eta 00m:06s]
Threads: 1: [VE_] [87.5% done] [ 15936/     0 kb/s] [eta 00m:04s]
fio: (groupid=0): err= 0: pid=16509
  read : io=100MiB, bw=3,726KiB/s, runt= 28142msec
    slat (msec): min=    0, max= 6076, avg=1595.63, stdev=2072.78
    clat (msec): min=    0, max=  505, avg=85.54, stdev=85.52
    bw (KiB/s) : min=    1, max=13139, per=37.93%, avg=4240.15, stdev=2954.11
  write: io=34,192KiB, bw=1,573KiB/s, runt= 22249msec
    slat (msec): min=    0, max=    4, avg= 0.04, stdev= 0.28
    clat (msec): min=    0, max=  858, avg=96.06, stdev=109.76
    bw (KiB/s) : min=    0, max= 5845, per=50.24%, avg=2224.00, stdev=1920.25
  cpu          : usr=3.38%, sys=0.18%, ctx=1970
  IO depths    : 1=0.1%, 2=0.3%, 4=14.8%, 8=84.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.2%, 4=1.2%, 10=5.5%, 20=14.6%, 50=22.7%, 100=21.3%
     lat (msec): 250=27.8%, 500=5.2%, 750=0.2%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16510
  read : io=100MiB, bw=3,757KiB/s, runt= 27905msec
    slat (msec): min=    0, max= 6033, avg=1256.24, stdev=2019.70
    clat (msec): min=    0, max=  515, avg=95.34, stdev=82.46
    bw (KiB/s) : min=   86, max=10977, per=38.08%, avg=4256.84, stdev=2376.56
  write: io=31,220KiB, bw=1,437KiB/s, runt= 22243msec
    slat (msec): min=    0, max=   11, avg= 0.16, stdev= 0.96
    clat (msec): min=    0, max= 1150, avg=100.66, stdev=123.30
    bw (KiB/s) : min=    0, max= 6011, per=59.87%, avg=2650.59, stdev=2230.88
  cpu          : usr=3.50%, sys=0.26%, ctx=1860
  IO depths    : 1=0.1%, 2=0.2%, 4=12.5%, 8=87.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.3%, 4=0.7%, 10=3.9%, 20=9.3%, 50=23.2%, 100=24.9%
     lat (msec): 250=29.6%, 500=6.6%, 750=0.1%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16511
  read : io=100MiB, bw=3,867KiB/s, runt= 27112msec
    slat (msec): min=    0, max= 5378, avg=723.19, stdev=1407.71
    clat (msec): min=    2, max=  795, avg=98.19, stdev=83.46
    bw (KiB/s) : min=  283, max=10301, per=36.35%, avg=4062.95, stdev=2370.21
  write: io=30,784KiB, bw=1,438KiB/s, runt= 21912msec
    slat (msec): min=    0, max=    3, avg= 0.07, stdev= 0.34
    clat (msec): min=    0, max=  825, avg=116.95, stdev=122.64
    bw (KiB/s) : min=    0, max= 7169, per=61.43%, avg=2719.35, stdev=2265.96
  cpu          : usr=3.10%, sys=0.27%, ctx=1770
  IO depths    : 1=0.1%, 2=0.2%, 4=10.3%, 8=89.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.6%, 4=0.3%, 10=2.0%, 20=8.6%, 50=20.8%, 100=29.5%
     lat (msec): 250=31.1%, 500=6.2%, 750=0.4%, 1000=0.2%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,178KiB/s, minb=3,726KiB/s, maxb=3,867KiB/s, mint=27112msec, maxt=28142msec
  WRITE: io=96,196KiB, aggrb=4,427KiB/s, minb=1,437KiB/s, maxb=1,573KiB/s, mint=27112msec, maxt=28142msec

Disk stats (read/write):
  sda: ios=5083/1967, merge=1499/307, ticks=489796/224700, in_queue=714496, util=98.68%
2.85user 0.25system 0:28.69elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2392minor)pagefaults 0swaps