fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [6.7% done] [  3261/ 18979 kb/s] [eta 00m:42s]
Threads: 3: [mFF] [7.0% done] [  1189/ 39175 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [45.5% done] [   984/ 55520 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [   338/ 33377 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  6640/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 27856/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 33472/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [78.3% done] [ 25199/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [82.6% done] [ 33533/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.9% done] [ 34768/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 29868/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35756/     0 kb/s] [eta 00m:00s]
Threads: 2: [VEV] [100.0% done] [ 28552/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=15105
  read : io=100MiB, bw=4,292KiB/s, runt= 24427msec
    slat (msec): min=  173, max=18840, avg=15101.05, stdev=4320.41
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=20081, per=55.84%, avg=7190.80, stdev=5696.77
  write: io=90,320KiB, bw=6,254KiB/s, runt= 14788msec
    slat (msec): min=    0, max=   11, avg= 1.66, stdev= 1.80
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=56931, per=145.50%, avg=28465.50, stdev=40256.30
  cpu          : usr=4.85%, sys=1.46%, ctx=978
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15106
  read : io=100MiB, bw=4,469KiB/s, runt= 23462msec
    slat (msec): min=  214, max=21351, avg=16610.16, stdev=3584.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=19852, per=79.68%, avg=10261.65, stdev=5732.15
  write: io=97,428KiB, bw=6,750KiB/s, runt= 14780msec
    slat (msec): min=    0, max=   16, avg= 1.80, stdev= 2.06
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112984, per=288.75%, avg=56492.00, stdev=79891.75
  cpu          : usr=5.13%, sys=1.65%, ctx=979
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15107
  read : io=100MiB, bw=4,354KiB/s, runt= 24079msec
    slat (msec): min=   52, max=20376, avg=15655.61, stdev=4116.12
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   20, max=16771, per=61.09%, avg=7867.42, stdev=5433.65
  write: io=94,788KiB, bw=6,568KiB/s, runt= 14776msec
    slat (msec): min=    0, max=   55, avg= 2.04, stdev= 3.81
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=102656, per=175.31%, avg=34297.67, stdev=59200.17
  cpu          : usr=5.13%, sys=1.21%, ctx=1037
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,878KiB/s, minb=4,292KiB/s, maxb=4,469KiB/s, mint=23462msec, maxt=24427msec
  WRITE: io=276MiB, aggrb=19,564KiB/s, minb=6,254KiB/s, maxb=6,750KiB/s, mint=23462msec, maxt=24427msec

Disk stats (read/write):
  sda: ios=3262/1822, merge=1184/68807, ticks=110772/1649156, in_queue=1759928, util=99.14%
3.68user 1.05system 0:24.75elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2420minor)pagefaults 0swaps