fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [50.0% done] [  2512/ 70120 kb/s] [eta 00m:03s]
Threads: 3: [FFm] [66.7% done] [    16/ 29384 kb/s] [eta 00m:02s]
Threads: 3: [FFF] [100.0% done] [  2336/   332 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  7592/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [67.9% done] [ 27644/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [69.0% done] [ 35202/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [72.4% done] [ 29620/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [78.6% done] [ 32096/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [82.1% done] [ 24168/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [88.9% done] [ 32264/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [100.0% done] [ 34008/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 36224/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=8439
  read : io=100MiB, bw=3,861KiB/s, runt= 27155msec
    slat (msec): min=  104, max=24511, avg=21612.16, stdev=4571.34
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=38616, per=81.57%, avg=9449.56, stdev=10056.61
  write: io=95,676KiB, bw=5,587KiB/s, runt= 17535msec
    slat (msec): min=    0, max=  117, avg= 2.04, stdev= 4.56
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=79892, per=207.92%, avg=34697.00, stdev=40967.53
  cpu          : usr=4.67%, sys=1.44%, ctx=985
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=8440
  read : io=100MiB, bw=4,068KiB/s, runt= 25772msec
    slat (msec): min=   20, max=23754, avg=18842.85, stdev=4572.53
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   15, max=18646, per=87.11%, avg=10090.47, stdev=6221.77
  write: io=97,128KiB, bw=5,673KiB/s, runt= 17531msec
    slat (msec): min=    0, max=   24, avg= 1.91, stdev= 2.41
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=109753, per=220.44%, avg=36786.33, stdev=63191.71
  cpu          : usr=5.00%, sys=1.38%, ctx=979
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=8441
  read : io=100MiB, bw=4,001KiB/s, runt= 26207msec
    slat (msec): min=    9, max=21653, avg=15912.35, stdev=5517.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    1, max=21017, per=70.09%, avg=8118.85, stdev=5858.39
  write: io=93,052KiB, bw=5,432KiB/s, runt= 17540msec
    slat (msec): min=    0, max=  215, avg= 3.58, stdev=17.16
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=109681, per=198.00%, avg=33042.60, stdev=48911.38
  cpu          : usr=4.64%, sys=1.40%, ctx=1140
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,584KiB/s, minb=3,861KiB/s, maxb=4,068KiB/s, mint=25772msec, maxt=27155msec
  WRITE: io=279MiB, aggrb=16,688KiB/s, minb=5,432KiB/s, maxb=5,673KiB/s, mint=25772msec, maxt=27155msec

Disk stats (read/write):
  sda: ios=3296/2604, merge=1241/68713, ticks=94880/2149236, in_queue=2244952, util=97.67%
3.82user 1.13system 0:27.65elapsed 17%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2434minor)pagefaults 0swaps