fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [  4428/112864 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [70.6% done] [  1520/     0 kb/s] [eta 00m:05s]
Threads: 3: [FVF] [76.5% done] [  9692/     0 kb/s] [eta 00m:04s]
Threads: 3: [FVF] [82.4% done] [  7896/     0 kb/s] [eta 00m:03s]
Threads: 3: [FVF] [88.2% done] [ 12188/     0 kb/s] [eta 00m:02s]
Threads: 3: [FVF] [94.1% done] [  7816/     0 kb/s] [eta 00m:01s]
Threads: 3: [FVF] [100.0% done] [ 13328/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [100.0% done] [ 19340/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [67.9% done] [ 20976/     0 kb/s] [eta 00m:09s]
Threads: 2: [V_V] [74.1% done] [ 23272/     0 kb/s] [eta 00m:07s]
Threads: 2: [V_V] [87.5% done] [ 34752/     0 kb/s] [eta 00m:03s]
Threads: 2: [V_V] [95.7% done] [ 32059/     0 kb/s] [eta 00m:01s]
Threads: 2: [V_V] [100.0% done] [ 37176/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 35240/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=14345
  read : io=100MiB, bw=4,172KiB/s, runt= 25133msec
    slat (msec): min=  118, max=22430, avg=19130.47, stdev=4247.07
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=25600, per=96.27%, avg=11922.33, stdev=8266.24
  write: io=95,436KiB, bw=5,325KiB/s, runt= 18349msec
    slat (msec): min=    0, max=  122, avg= 2.23, stdev= 6.37
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=90865, per=189.86%, avg=30355.33, stdev=52403.00
  cpu          : usr=4.66%, sys=1.67%, ctx=901
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14346
  read : io=100MiB, bw=5,340KiB/s, runt= 19633msec
    slat (msec): min=   35, max=17560, avg=14150.87, stdev=3288.93
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=25516, per=83.52%, avg=10343.12, stdev=6610.37
  write: io=96,184KiB, bw=8,417KiB/s, runt= 11701msec
    slat (msec): min=    0, max=   44, avg= 2.35, stdev= 4.13
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=115515, per=301.48%, avg=48200.75, stdev=57418.00
  cpu          : usr=6.76%, sys=1.94%, ctx=875
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14347
  read : io=100MiB, bw=4,128KiB/s, runt= 25400msec
    slat (msec): min=   77, max=22646, avg=19255.08, stdev=4397.42
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=21188, per=89.47%, avg=11079.67, stdev=7809.12
  write: io=94,884KiB, bw=5,296KiB/s, runt= 18345msec
    slat (msec): min=    0, max=  237, avg= 2.96, stdev=12.51
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=55997, per=117.21%, avg=18739.67, stdev=32265.99
  cpu          : usr=5.10%, sys=1.57%, ctx=955
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,384KiB/s, minb=4,128KiB/s, maxb=5,340KiB/s, mint=19633msec, maxt=25400msec
  WRITE: io=280MiB, aggrb=15,988KiB/s, minb=5,296KiB/s, maxb=8,417KiB/s, mint=19633msec, maxt=25400msec

Disk stats (read/write):
  sda: ios=3257/2267, merge=1302/69130, ticks=62504/2144032, in_queue=2228776, util=98.08%
3.84user 1.21system 0:25.69elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2413minor)pagefaults 0swaps