fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [8.3% done] [  8163/132201 kb/s] [eta 00m:33s]
Threads: 3: [FFm] [8.3% done] [     0/  3214 kb/s] [eta 00m:44s]
Threads: 3: [FFm] [8.3% done] [     0/     0 kb/s] [eta 00m:55s]
Threads: 3: [FFm] [10.0% done] [   853/     0 kb/s] [eta 00m:54s]
Threads: 3: [FFm] [11.7% done] [     0/     0 kb/s] [eta 00m:53s]
Threads: 3: [FFm] [13.3% done] [     0/     0 kb/s] [eta 00m:52s]
Threads: 3: [FFm] [15.0% done] [     0/     0 kb/s] [eta 00m:51s]
Threads: 3: [FFm] [16.7% done] [     0/     0 kb/s] [eta 00m:50s]
Threads: 3: [FFm] [18.3% done] [   942/     0 kb/s] [eta 00m:49s]
Threads: 3: [VVm] [44.4% done] [   690/ 51581 kb/s] [eta 00m:15s]
Threads: 3: [VVm] [44.8% done] [ 27123/  2165 kb/s] [eta 00m:16s]
Threads: 3: [VVm] [45.2% done] [ 29005/     0 kb/s] [eta 00m:17s]
Threads: 3: [VVm] [45.5% done] [ 33974/     0 kb/s] [eta 00m:18s]
Threads: 3: [VVm] [45.7% done] [ 37510/     0 kb/s] [eta 00m:19s]
Threads: 3: [VVm] [45.9% done] [ 22307/     0 kb/s] [eta 00m:20s]
Threads: 3: [VVm] [46.2% done] [ 27696/     0 kb/s] [eta 00m:21s]
Threads: 1: [__m] [45.2% done] [ 16104/     0 kb/s] [eta 00m:23s]
Threads: 1: [__m] [45.5% done] [     0/     0 kb/s] [eta 00m:24s]
Threads: 1: [__m] [46.7% done] [  1004/     0 kb/s] [eta 00m:24s]
Threads: 1: [__m] [51.2% done] [  8148/     0 kb/s] [eta 00m:21s]
Threads: 1: [__F] [100.0% done] [  1424/ 22480 kb/s] [eta 00m:00s]
Threads: 1: [__V] [66.7% done] [     0/     0 kb/s] [eta 00m:12s]
Threads: 1: [__V] [83.3% done] [ 22372/     0 kb/s] [eta 00m:05s]
Threads: 1: [__V] [100.0% done] [ 27920/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5555
  read : io=100MiB, bw=5,701KiB/s, runt= 18390msec
    slat (msec): min=  135, max=15666, avg=12217.68, stdev=2824.52
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=21136, per=101.93%, avg=11810.13, stdev=6503.46
  write: io=94,040KiB, bw=8,162KiB/s, runt= 11798msec
    slat (msec): min=    0, max=   11, avg= 1.82, stdev= 1.89
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=113643, per=502.18%, avg=56821.50, stdev=80357.74
  cpu          : usr=6.70%, sys=2.07%, ctx=903
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5556
  read : io=100MiB, bw=5,585KiB/s, runt= 18774msec
    slat (msec): min=   25, max=15788, avg=11919.65, stdev=3079.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   16, max=20519, per=91.33%, avg=10581.31, stdev=7198.29
  write: io=96,344KiB, bw=8,364KiB/s, runt= 11794msec
    slat (msec): min=    0, max=  198, avg= 3.03, stdev=14.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=108536, per=394.20%, avg=44603.50, stdev=53481.08
  cpu          : usr=6.69%, sys=1.85%, ctx=965
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5557
  read : io=100MiB, bw=3,862KiB/s, runt= 27150msec
    slat (msec): min=   32, max= 5318, avg=2788.38, stdev=1450.31
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   39, max=33635, per=71.51%, avg=8284.57, stdev=11186.84
  write: io=75,388KiB, bw=3,209KiB/s, runt= 24051msec
    slat (msec): min=    0, max=  122, avg= 2.29, stdev= 8.44
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=88343, per=260.36%, avg=29459.67, stdev=50994.47
  cpu          : usr=4.20%, sys=1.21%, ctx=1301
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,586KiB/s, minb=3,862KiB/s, maxb=5,701KiB/s, mint=18390msec, maxt=27150msec
  WRITE: io=260MiB, aggrb=11,315KiB/s, minb=3,209KiB/s, maxb=8,364KiB/s, mint=18390msec, maxt=27150msec

Disk stats (read/write):
  sda: ios=3722/2959, merge=1304/63382, ticks=82316/1950376, in_queue=2032792, util=97.02%
3.69user 1.10system 0:27.48elapsed 17%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2426minor)pagefaults 0swaps