fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.5% done] [ 10264/  9840 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [15.4% done] [ 10880/  8136 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [20.0% done] [  9968/  8220 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [23.1% done] [ 13216/  1900 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [25.9% done] [ 13572/  3392 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [29.6% done] [ 10564/  3372 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [33.3% done] [ 10644/  2832 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [37.0% done] [ 13276/  3080 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [40.7% done] [ 10860/  3556 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [44.4% done] [ 10496/  4044 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [48.1% done] [ 13264/   168 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [50.0% done] [ 13088/   328 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [53.6% done] [  9496/  2240 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [55.2% done] [  3904/  6132 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [56.7% done] [ 10588/   236 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [60.0% done] [  8412/  1896 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [61.3% done] [  5808/  3672 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [64.5% done] [  3072/  6380 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [65.6% done] [  6448/  2544 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [66.7% done] [  5148/  3804 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [69.7% done] [ 15984/     0 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [72.7% done] [ 15772/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [78.1% done] [ 17740/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [81.2% done] [ 17952/     0 kb/s] [eta 00m:06s]
Threads: 2: [V_V] [84.4% done] [ 16424/     0 kb/s] [eta 00m:05s]
fio: (groupid=0): err= 0: pid=17108
  read : io=100MiB, bw=3,788KiB/s, runt= 27677msec
    slat (msec): min=    0, max= 5472, avg=1107.96, stdev=1769.57
    clat (msec): min=    0, max=  831, avg=94.87, stdev=93.10
    bw (KiB/s) : min=    4, max=10359, per=35.42%, avg=4025.89, stdev=2337.08
  write: io=26,828KiB, bw=1,235KiB/s, runt= 22238msec
    slat (msec): min=    0, max=    3, avg= 0.03, stdev= 0.22
    clat (msec): min=    0, max=  882, avg=95.76, stdev=125.25
    bw (KiB/s) : min=    0, max= 6604, per=51.63%, avg=2085.52, stdev=2065.76
  cpu          : usr=3.27%, sys=0.20%, ctx=1879
  IO depths    : 1=0.1%, 2=0.3%, 4=12.1%, 8=87.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.1%, 4=0.8%, 10=6.0%, 20=13.2%, 50=21.2%, 100=22.2%
     lat (msec): 250=28.5%, 500=6.3%, 750=0.4%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17109
  read : io=100MiB, bw=3,903KiB/s, runt= 26863msec
    slat (msec): min=    0, max= 5336, avg=806.58, stdev=1544.19
    clat (msec): min=    2, max=  457, avg=89.32, stdev=72.99
    bw (KiB/s) : min=   69, max=10014, per=35.60%, avg=4045.85, stdev=2372.89
  write: io=29,328KiB, bw=1,406KiB/s, runt= 21348msec
    slat (msec): min=    0, max=    3, avg= 0.04, stdev= 0.29
    clat (msec): min=    0, max=  785, avg=108.37, stdev=113.33
    bw (KiB/s) : min=    0, max= 8439, per=60.52%, avg=2444.52, stdev=2350.13
  cpu          : usr=3.19%, sys=0.28%, ctx=1909
  IO depths    : 1=0.1%, 2=0.3%, 4=9.3%, 8=90.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.0%, 4=0.2%, 10=2.8%, 20=10.4%, 50=21.7%, 100=29.4%
     lat (msec): 250=28.9%, 500=5.0%, 750=0.4%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17110
  read : io=100MiB, bw=3,808KiB/s, runt= 27535msec
    slat (msec): min=    0, max= 5758, avg=1127.60, stdev=1842.74
    clat (msec): min=    2, max=  486, avg=92.10, stdev=74.92
    bw (KiB/s) : min=   58, max= 8460, per=35.53%, avg=4038.07, stdev=2261.80
  write: io=31,564KiB, bw=1,476KiB/s, runt= 21892msec
    slat (msec): min=    0, max=    8, avg= 0.12, stdev= 0.73
    clat (msec): min=    0, max= 1286, avg=116.19, stdev=151.88
    bw (KiB/s) : min=    0, max= 6932, per=52.47%, avg=2119.38, stdev=1896.91
  cpu          : usr=3.34%, sys=0.16%, ctx=1853
  IO depths    : 1=0.1%, 2=0.3%, 4=11.6%, 8=88.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.0%, 4=0.9%, 10=3.0%, 20=10.2%, 50=20.8%, 100=27.4%
     lat (msec): 250=30.2%, 500=5.6%, 750=0.8%, 1000=0.1%, >=2000=0.1%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,365KiB/s, minb=3,788KiB/s, maxb=3,903KiB/s, mint=26863msec, maxt=27677msec
  WRITE: io=87,720KiB, aggrb=4,039KiB/s, minb=1,235KiB/s, maxb=1,476KiB/s, mint=26863msec, maxt=27677msec

Disk stats (read/write):
  sda: ios=5222/1712, merge=1336/217, ticks=494512/368192, in_queue=862712, util=99.45%
2.72user 0.29system 0:27.95elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2391minor)pagefaults 0swaps