fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [6.4% done] [     0/     0 kb/s] [eta 00m:44s]
Threads: 3: [Fmm] [6.7% done] [     0/     0 kb/s] [eta 00m:56s]
Threads: 3: [Fmm] [8.3% done] [   428/     0 kb/s] [eta 00m:55s]
Threads: 3: [Fmm] [10.0% done] [     0/     0 kb/s] [eta 00m:54s]
Threads: 3: [Fmm] [11.7% done] [  1900/     0 kb/s] [eta 00m:53s]
Threads: 3: [VmF] [13.3% done] [  9132/ 45260 kb/s] [eta 00m:52s]
Threads: 3: [VmF] [15.0% done] [     0/     0 kb/s] [eta 00m:51s]
Threads: 3: [VmF] [16.7% done] [   772/     0 kb/s] [eta 00m:50s]
Threads: 3: [VmV] [18.3% done] [ 14340/     0 kb/s] [eta 00m:49s]
Threads: 3: [VmV] [20.0% done] [ 27436/  9144 kb/s] [eta 00m:48s]
Threads: 3: [VmV] [43.3% done] [ 33432/ 41064 kb/s] [eta 00m:17s]
Threads: 3: [VFV] [100.0% done] [ 36400/ 35952 kb/s] [eta 00m:00s]
Threads: 3: [VFV] [100.0% done] [  9724/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFV] [100.0% done] [   344/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFV] [100.0% done] [  1020/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFV] [100.0% done] [ 13044/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFV] [100.0% done] [ 21780/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFV] [100.0% done] [ 22856/     0 kb/s] [eta 00m:00s]
Threads: 1: [_V_] [72.4% done] [ 21260/     0 kb/s] [eta 00m:08s]
Threads: 1: [_V_] [95.7% done] [ 30920/     0 kb/s] [eta 00m:01s]
Threads: 1: [_V_] [100.0% done] [ 30012/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=2378
  read : io=100MiB, bw=5,023KiB/s, runt= 20874msec
    slat (msec): min=  214, max=19369, avg=12673.35, stdev=3677.49
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=23499, per=66.50%, avg=8761.68, stdev=7728.15
  write: io=98MiB, bw=13,302KiB/s, runt=  7727msec
    slat (msec): min=    0, max=   17, avg= 2.10, stdev= 2.25
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=104648, per=377.30%, avg=52324.00, stdev=73997.31
  cpu          : usr=5.92%, sys=2.20%, ctx=761
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2379
  read : io=100MiB, bw=4,391KiB/s, runt= 23875msec
    slat (msec): min=   58, max=10058, avg=8115.10, stdev=2349.20
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   33, max=32597, per=93.90%, avg=12371.50, stdev=14573.69
  write: io=86,160KiB, bw=4,223KiB/s, runt= 20889msec
    slat (msec): min=    0, max=  952, avg= 3.11, stdev=34.47
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=35742, per=128.87%, avg=17871.00, stdev=25273.41
  cpu          : usr=4.98%, sys=1.74%, ctx=1086
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2380
  read : io=100MiB, bw=5,042KiB/s, runt= 20796msec
    slat (msec): min=  117, max=12862, avg=7854.48, stdev=3555.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   54, max=21866, per=66.27%, avg=8730.90, stdev=7553.73
  write: io=96,372KiB, bw=9,447KiB/s, runt= 10446msec
    slat (msec): min=    0, max=   12, avg= 2.12, stdev= 2.12
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max= 7502, per=27.05%, avg=3751.00, stdev=5304.72
  cpu          : usr=5.85%, sys=2.31%, ctx=856
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,175KiB/s, minb=4,391KiB/s, maxb=5,042KiB/s, mint=20796msec, maxt=23875msec
  WRITE: io=276MiB, aggrb=13,868KiB/s, minb=4,223KiB/s, maxb=13,302KiB/s, mint=20796msec, maxt=23875msec

Disk stats (read/write):
  sda: ios=3328/2245, merge=1241/68266, ticks=73880/1866916, in_queue=1966668, util=97.87%
3.70user 1.40system 0:24.24elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2422minor)pagefaults 0swaps