fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [7.7% done] [  1232/     0 kb/s] [eta 00m:36s]
Threads: 3: [mFF] [7.7% done] [     0/     0 kb/s] [eta 00m:48s]
Threads: 3: [mFF] [8.3% done] [     0/     0 kb/s] [eta 00m:55s]
Threads: 3: [mFF] [10.0% done] [     0/     0 kb/s] [eta 00m:54s]
Threads: 3: [mFF] [11.7% done] [     0/     0 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [13.3% done] [     0/     0 kb/s] [eta 00m:52s]
Threads: 3: [mFF] [15.0% done] [     0/     0 kb/s] [eta 00m:51s]
Threads: 3: [mFF] [16.7% done] [     0/     0 kb/s] [eta 00m:50s]
Threads: 3: [mVV] [18.3% done] [ 15804/     0 kb/s] [eta 00m:49s]
Threads: 3: [mVV] [20.0% done] [ 35824/     0 kb/s] [eta 00m:48s]
Threads: 3: [mVV] [21.7% done] [ 28404/     0 kb/s] [eta 00m:47s]
Threads: 3: [mVV] [23.3% done] [ 36552/     0 kb/s] [eta 00m:46s]
Threads: 3: [mVV] [25.0% done] [ 28704/     0 kb/s] [eta 00m:45s]
Threads: 3: [mVV] [26.7% done] [ 33948/ 20080 kb/s] [eta 00m:44s]
Threads: 1: [m__] [44.7% done] [ 26088/ 29728 kb/s] [eta 00m:21s]
Threads: 1: [m__] [50.0% done] [  8732/     0 kb/s] [eta 00m:18s]
Threads: 1: [m__] [57.6% done] [  9580/     0 kb/s] [eta 00m:14s]
Threads: 1: [F__] [100.0% done] [  3908/ 12368 kb/s] [eta 00m:00s]
Threads: 1: [F__] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [68.8% done] [  1688/     0 kb/s] [eta 00m:10s]
Threads: 1: [V__] [85.2% done] [ 22344/     0 kb/s] [eta 00m:04s]
Threads: 1: [V__] [100.0% done] [ 26188/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5057
  read : io=100MiB, bw=4,221KiB/s, runt= 24841msec
    slat (msec): min=   15, max= 7844, avg=2506.79, stdev=1964.16
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    1, max=28744, per=67.73%, avg=8576.50, stdev=9386.87
  write: io=62,176KiB, bw=2,856KiB/s, runt= 22287msec
    slat (msec): min=    0, max=  108, avg= 2.92, stdev= 7.94
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=85160, per=236.72%, avg=28415.33, stdev=49142.34
  cpu          : usr=4.15%, sys=1.48%, ctx=1536
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.8%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5058
  read : io=100MiB, bw=6,386KiB/s, runt= 16418msec
    slat (msec): min=   30, max=14921, avg=11856.23, stdev=2390.29
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=22718, per=114.86%, avg=14544.23, stdev=7494.04
  write: io=99,792KiB, bw=10,095KiB/s, runt= 10122msec
    slat (msec): min=    0, max=   36, avg= 2.33, stdev= 3.06
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=99587, per=285.27%, avg=34244.00, stdev=56610.54
  cpu          : usr=7.89%, sys=2.27%, ctx=834
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5059
  read : io=100MiB, bw=6,148KiB/s, runt= 17054msec
    slat (msec): min=  129, max=15460, avg=12581.04, stdev=2421.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   16, max=23945, per=103.24%, avg=13073.38, stdev=6775.41
  write: io=99,316KiB, bw=10,029KiB/s, runt= 10140msec
    slat (msec): min=    0, max=   13, avg= 2.35, stdev= 2.17
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=104607, per=435.72%, avg=52303.50, stdev=73968.32
  cpu          : usr=7.15%, sys=2.77%, ctx=797
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,663KiB/s, minb=4,221KiB/s, maxb=6,386KiB/s, mint=16418msec, maxt=24841msec
  WRITE: io=255MiB, aggrb=12,004KiB/s, minb=2,856KiB/s, maxb=10,095KiB/s, mint=16418msec, maxt=24841msec

Disk stats (read/write):
  sda: ios=3725/2061, merge=1092/63024, ticks=66412/1465216, in_queue=1536524, util=95.46%
3.59user 1.26system 0:25.42elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2410minor)pagefaults 0swaps