fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [37.5% done] [  2216/ 45404 kb/s] [eta 00m:05s]
Threads: 3: [FFm] [40.0% done] [  1444/     0 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [   692/ 42688 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [66.7% done] [     0/     0 kb/s] [eta 00m:06s]
Threads: 3: [FVF] [72.2% done] [  3472/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVF] [66.7% done] [  4620/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.2% done] [ 19811/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 26056/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.0% done] [ 28108/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [85.7% done] [ 32728/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.0% done] [ 36996/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 30232/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 39448/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 35844/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [100.0% done] [ 28544/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=25289
  read : io=100MiB, bw=4,494KiB/s, runt= 23332msec
    slat (msec): min=   52, max=20877, avg=16362.67, stdev=4971.56
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=20913, per=71.46%, avg=9595.83, stdev=5415.65
  write: io=91,844KiB, bw=6,631KiB/s, runt= 14182msec
    slat (msec): min=    0, max=   84, avg= 2.09, stdev= 5.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=32284, per=78.19%, avg=16142.00, stdev=22828.24
  cpu          : usr=5.06%, sys=1.49%, ctx=893
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25290
  read : io=100MiB, bw=4,714KiB/s, runt= 22240msec
    slat (msec): min=   84, max=20641, avg=16025.89, stdev=3652.84
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    2, max=21087, per=67.77%, avg=9100.80, stdev=6301.37
  write: io=99,824KiB, bw=8,466KiB/s, runt= 12074msec
    slat (msec): min=    0, max=   87, avg= 2.23, stdev= 5.49
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=90674, per=147.65%, avg=30482.33, stdev=52128.95
  cpu          : usr=5.79%, sys=1.76%, ctx=819
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25291
  read : io=100MiB, bw=4,476KiB/s, runt= 23426msec
    slat (msec): min=   79, max=18778, avg=13988.29, stdev=4359.62
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   16, max=17784, per=56.60%, avg=7600.48, stdev=5387.86
  write: io=94,260KiB, bw=6,807KiB/s, runt= 14178msec
    slat (msec): min=    0, max=  133, avg= 2.05, stdev= 4.01
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=85696, per=138.37%, avg=28567.33, stdev=49474.88
  cpu          : usr=5.28%, sys=1.69%, ctx=903
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,428KiB/s, minb=4,476KiB/s, maxb=4,714KiB/s, mint=22240msec, maxt=23426msec
  WRITE: io=279MiB, aggrb=20,645KiB/s, minb=6,631KiB/s, maxb=8,466KiB/s, mint=22240msec, maxt=23426msec

Disk stats (read/write):
  sda: ios=3222/1951, merge=1344/69338, ticks=82056/1697200, in_queue=1784436, util=99.05%
3.75user 1.17system 0:23.69elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2416minor)pagefaults 0swaps