fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [42.9% done] [  1076/   136 kb/s] [eta 00m:04s]
Threads: 3: [mmF] [40.0% done] [  1072/     0 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [41.7% done] [  1472/ 40876 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [42.9% done] [     0/     0 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [41.2% done] [     0/     0 kb/s] [eta 00m:10s]
Threads: 3: [mFF] [42.1% done] [     0/     0 kb/s] [eta 00m:11s]
Threads: 3: [mFF] [40.9% done] [     0/     0 kb/s] [eta 00m:13s]
Threads: 3: [mFF] [41.7% done] [   696/     0 kb/s] [eta 00m:14s]
Threads: 3: [mFF] [40.7% done] [     0/     0 kb/s] [eta 00m:16s]
Threads: 3: [mFF] [41.4% done] [     0/     0 kb/s] [eta 00m:17s]
Threads: 3: [mFF] [65.0% done] [   700/ 32416 kb/s] [eta 00m:07s]
Threads: 3: [FFF] [100.0% done] [     0/  6736 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [68.2% done] [     0/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 13408/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.0% done] [ 33816/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 29788/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [73.1% done] [ 37220/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.9% done] [ 31196/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.8% done] [ 24808/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [88.0% done] [ 37356/     0 kb/s] [eta 00m:03s]
Threads: 1: [V__] [100.0% done] [ 34776/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 38352/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=4099
  read : io=100MiB, bw=4,252KiB/s, runt= 24656msec
    slat (msec): min=  117, max=11416, avg=9117.91, stdev=2584.30
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    1, max=36993, per=59.44%, avg=7583.26, stdev=10581.76
  write: io=93,256KiB, bw=6,120KiB/s, runt= 15602msec
    slat (msec): min=    0, max= 1069, avg= 3.81, stdev=45.85
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=35527, per=62.63%, avg=11847.00, stdev=20507.48
  cpu          : usr=4.87%, sys=1.52%, ctx=971
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4100
  read : io=100MiB, bw=4,508KiB/s, runt= 23260msec
    slat (msec): min=   44, max=18373, avg=13602.07, stdev=3786.02
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   21, max=18904, per=71.22%, avg=9086.68, stdev=6736.39
  write: io=95,668KiB, bw=6,508KiB/s, runt= 15052msec
    slat (msec): min=    0, max=  210, avg= 1.83, stdev= 5.54
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=80062, per=141.10%, avg=26688.33, stdev=46222.95
  cpu          : usr=5.19%, sys=1.69%, ctx=977
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4101
  read : io=100MiB, bw=4,494KiB/s, runt= 23331msec
    slat (msec): min=  164, max=21813, avg=17914.37, stdev=2958.53
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=22572, per=89.66%, avg=11438.80, stdev=6266.68
  write: io=99,284KiB, bw=6,746KiB/s, runt= 15069msec
    slat (msec): min=    0, max=   10, avg= 1.73, stdev= 1.86
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=116366, per=307.60%, avg=58183.00, stdev=82283.19
  cpu          : usr=5.28%, sys=1.47%, ctx=911
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,758KiB/s, minb=4,252KiB/s, maxb=4,508KiB/s, mint=23260msec, maxt=24656msec
  WRITE: io=281MiB, aggrb=18,915KiB/s, minb=6,120KiB/s, maxb=6,746KiB/s, mint=23260msec, maxt=24656msec

Disk stats (read/write):
  sda: ios=3223/2767, merge=1305/69250, ticks=107852/1797444, in_queue=1905296, util=98.67%
3.70user 1.19system 0:24.96elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2425minor)pagefaults 0swaps