fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [8.1% done] [     0/ 11763 kb/s] [eta 00m:34s]
Threads: 3: [FmF] [8.2% done] [     0/     0 kb/s] [eta 00m:45s]
Threads: 3: [FmF] [8.3% done] [     0/     0 kb/s] [eta 00m:55s]
Threads: 3: [FmF] [10.0% done] [  1264/     0 kb/s] [eta 00m:54s]
Threads: 3: [FmF] [11.7% done] [     0/     0 kb/s] [eta 00m:53s]
Threads: 3: [FmF] [13.3% done] [     0/     0 kb/s] [eta 00m:52s]
Threads: 3: [FmF] [26.5% done] [  1104/ 25188 kb/s] [eta 00m:25s]
Threads: 3: [FFF] [100.0% done] [     0/ 62488 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  7100/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 25656/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 32556/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [78.3% done] [ 28136/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [82.6% done] [ 33900/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.9% done] [ 37988/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.5% done] [ 29652/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 36944/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 35999/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5509
  read : io=100MiB, bw=4,385KiB/s, runt= 23911msec
    slat (msec): min=  183, max=22116, avg=19388.20, stdev=3208.01
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=39124, per=74.49%, avg=9798.94, stdev=10035.10
  write: io=98MiB, bw=7,102KiB/s, runt= 14529msec
    slat (msec): min=    0, max=   15, avg= 2.10, stdev= 2.22
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=38448, per=95.05%, avg=19224.00, stdev=27186.84
  cpu          : usr=5.14%, sys=1.97%, ctx=800
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5510
  read : io=100MiB, bw=4,543KiB/s, runt= 23077msec
    slat (msec): min=   54, max=13422, avg=8926.89, stdev=3443.04
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   13, max=14395, per=62.38%, avg=8205.95, stdev=4204.28
  write: io=87,676KiB, bw=6,179KiB/s, runt= 14529msec
    slat (msec): min=    0, max=   10, avg= 1.68, stdev= 1.79
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=113309, per=280.12%, avg=56654.50, stdev=80121.56
  cpu          : usr=5.43%, sys=1.54%, ctx=1010
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5511
  read : io=100MiB, bw=4,677KiB/s, runt= 22418msec
    slat (msec): min=   48, max=20380, avg=16461.17, stdev=3714.42
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=21291, per=84.25%, avg=11083.06, stdev=6723.76
  write: io=98,808KiB, bw=6,956KiB/s, runt= 14544msec
    slat (msec): min=    0, max=  129, avg= 2.54, stdev= 7.38
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=85850, per=141.96%, avg=28711.67, stdev=49483.45
  cpu          : usr=5.41%, sys=1.87%, ctx=911
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,155KiB/s, minb=4,385KiB/s, maxb=4,677KiB/s, mint=22418msec, maxt=23911msec
  WRITE: io=281MiB, aggrb=20,225KiB/s, minb=6,179KiB/s, maxb=7,102KiB/s, mint=22418msec, maxt=23911msec

Disk stats (read/write):
  sda: ios=3282/2427, merge=1193/69234, ticks=65248/1772924, in_queue=1838328, util=98.51%
3.76user 1.29system 0:24.23elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2424minor)pagefaults 0swaps