fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [9.4% done] [ 10620/ 46000 kb/s] [eta 00m:29s]
Threads: 3: [mmm] [11.8% done] [ 10816/  1464 kb/s] [eta 00m:30s]
Threads: 3: [mmF] [14.3% done] [  7364/ 42728 kb/s] [eta 00m:30s]
Threads: 3: [FmF] [15.4% done] [  1812/ 20688 kb/s] [eta 00m:33s]
Threads: 3: [FmF] [50.0% done] [  2280/ 46488 kb/s] [eta 00m:07s]
Threads: 3: [FmF] [57.1% done] [  1177/ 10177 kb/s] [eta 00m:06s]
Threads: 3: [FmF] [56.2% done] [  1064/     0 kb/s] [eta 00m:07s]
Threads: 3: [FmF] [58.8% done] [  1265/     0 kb/s] [eta 00m:07s]
Threads: 3: [FFF] [100.0% done] [   984/ 15820 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  4627/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [67.9% done] [ 16264/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [71.4% done] [ 22896/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [77.8% done] [ 24092/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [88.0% done] [ 30204/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.8% done] [ 32936/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 31412/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30016/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 26512/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=11784
  read : io=100MiB, bw=3,814KiB/s, runt= 27491msec
    slat (msec): min=   30, max=22316, avg=16445.33, stdev=6437.34
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=25362, per=64.35%, avg=7363.00, stdev=6661.53
  write: io=87,372KiB, bw=5,021KiB/s, runt= 17816msec
    slat (msec): min=    0, max=   34, avg= 1.94, stdev= 2.65
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=107299, per=251.55%, avg=35795.67, stdev=61923.72
  cpu          : usr=4.28%, sys=1.08%, ctx=1086
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=11785
  read : io=100MiB, bw=3,919KiB/s, runt= 26750msec
    slat (msec): min=   12, max=15651, avg=9500.08, stdev=5224.40
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   20, max=16505, per=46.15%, avg=5280.94, stdev=4112.21
  write: io=72,476KiB, bw=4,168KiB/s, runt= 17806msec
    slat (msec): min=    0, max=   14, avg= 1.61, stdev= 1.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114314, per=268.02%, avg=38138.67, stdev=65969.79
  cpu          : usr=3.96%, sys=1.35%, ctx=1337
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=11786
  read : io=100MiB, bw=3,833KiB/s, runt= 27356msec
    slat (msec): min=   72, max=23122, avg=17242.17, stdev=6182.17
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=22118, per=69.14%, avg=7910.91, stdev=5199.58
  write: io=87,848KiB, bw=5,046KiB/s, runt= 17824msec
    slat (msec): min=    0, max=   12, avg= 1.76, stdev= 1.93
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=26629, per=93.57%, avg=13314.50, stdev=18829.55
  cpu          : usr=4.09%, sys=1.29%, ctx=1066
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,442KiB/s, minb=3,814KiB/s, maxb=3,919KiB/s, mint=26750msec, maxt=27491msec
  WRITE: io=242MiB, aggrb=14,230KiB/s, minb=4,168KiB/s, maxb=5,046KiB/s, mint=26750msec, maxt=27491msec

Disk stats (read/write):
  sda: ios=4027/2292, merge=1207/59492, ticks=88576/2012636, in_queue=2101216, util=99.40%
3.40user 1.04system 0:27.84elapsed 15%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2421minor)pagefaults 0swaps