fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.1% done] [ 10369/  8396 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [15.4% done] [ 15907/  3351 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [18.5% done] [  9515/  8365 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [23.1% done] [ 10208/  6904 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [26.9% done] [ 10358/  5620 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [29.6% done] [ 13079/  2469 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [33.3% done] [  9696/  4982 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [37.0% done] [  9991/  4852 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [40.7% done] [  9728/  5450 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [44.4% done] [  4379/  9397 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [46.4% done] [  6750/  6325 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [50.0% done] [ 10728/  2134 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [51.7% done] [  7880/  4493 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [55.2% done] [  8987/  3300 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [56.7% done] [  6608/  5045 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [58.1% done] [  5131/  5395 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [59.4% done] [  6514/  2871 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [62.5% done] [ 10401/     0 kb/s] [eta 00m:12s]
Threads: 3: [VVV] [67.7% done] [ 10117/     0 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.0% done] [ 19940/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [74.2% done] [ 19105/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [80.0% done] [ 20184/     0 kb/s] [eta 00m:06s]
Threads: 2: [V_V] [86.2% done] [ 19310/     0 kb/s] [eta 00m:04s]
fio: (groupid=0): err= 0: pid=29396
  read : io=100MiB, bw=3,925KiB/s, runt= 26710msec
    slat (msec): min=    0, max= 5305, avg=1233.37, stdev=1810.40
    clat (msec): min=    1, max=  736, avg=74.39, stdev=89.58
    bw (KiB/s) : min=  151, max=24010, per=42.70%, avg=5028.97, stdev=4575.47
  write: io=49,160KiB, bw=2,352KiB/s, runt= 21401msec
    slat (msec): min=    0, max=    3, avg= 0.09, stdev= 0.38
    clat (msec): min=    0, max=  975, avg=141.86, stdev=166.95
    bw (KiB/s) : min=    0, max= 8852, per=58.10%, avg=2818.62, stdev=2229.40
  cpu          : usr=3.50%, sys=0.34%, ctx=1758
  IO depths    : 1=0.1%, 2=0.2%, 4=15.1%, 8=84.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.0%, 4=0.9%, 10=6.3%, 20=17.6%, 50=24.7%, 100=18.2%
     lat (msec): 250=23.0%, 500=6.5%, 750=1.0%, 1000=0.7%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=29397
  read : io=100MiB, bw=4,069KiB/s, runt= 25768msec
    slat (msec): min=    0, max= 6457, avg=966.07, stdev=1845.57
    clat (msec): min=    3, max=  663, avg=94.09, stdev=83.48
    bw (KiB/s) : min=    8, max= 9466, per=39.57%, avg=4660.62, stdev=2524.71
  write: io=25,064KiB, bw=1,322KiB/s, runt= 19409msec
    slat (msec): min=    0, max=    6, avg= 0.08, stdev= 0.49
    clat (msec): min=    0, max=  893, avg=120.64, stdev=112.59
    bw (KiB/s) : min=    0, max= 5532, per=53.52%, avg=2596.29, stdev=2199.62
  cpu          : usr=3.01%, sys=0.28%, ctx=1610
  IO depths    : 1=0.2%, 2=0.3%, 4=10.9%, 8=88.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.1%, 4=0.1%, 10=2.0%, 20=8.6%, 50=25.2%, 100=25.6%
     lat (msec): 250=31.4%, 500=6.3%, 750=0.4%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=29398
  read : io=100MiB, bw=4,049KiB/s, runt= 25896msec
    slat (msec): min=    0, max= 5335, avg=1001.55, stdev=1694.49
    clat (msec): min=    3, max=  835, avg=90.21, stdev=87.91
    bw (KiB/s) : min=    6, max= 9752, per=36.75%, avg=4327.86, stdev=2606.57
  write: io=27,168KiB, bw=1,350KiB/s, runt= 20596msec
    slat (msec): min=    0, max=    3, avg= 0.08, stdev= 0.33
    clat (msec): min=    0, max=  945, avg=104.17, stdev=121.80
    bw (KiB/s) : min=    0, max= 6422, per=48.24%, avg=2340.00, stdev=2252.15
  cpu          : usr=3.57%, sys=0.19%, ctx=1785
  IO depths    : 1=0.1%, 2=0.2%, 4=11.6%, 8=88.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.1%, 4=0.2%, 10=3.4%, 20=11.0%, 50=27.6%, 100=23.4%
     lat (msec): 250=27.2%, 500=6.1%, 750=0.4%, 1000=0.3%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,777KiB/s, minb=3,925KiB/s, maxb=4,069KiB/s, mint=25768msec, maxt=26710msec
  WRITE: io=99MiB, aggrb=4,851KiB/s, minb=1,322KiB/s, maxb=2,352KiB/s, mint=25768msec, maxt=26710msec

Disk stats (read/write):
  sda: ios=4863/1641, merge=1323/356, ticks=432020/245560, in_queue=677588, util=99.54%
2.69user 0.22system 0:26.95elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2390minor)pagefaults 0swaps