fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [60.0% done] [  1204/ 40768 kb/s] [eta 00m:02s]
Threads: 3: [Fmm] [66.7% done] [  4948/     0 kb/s] [eta 00m:02s]
Threads: 3: [FFm] [62.5% done] [  3488/  3604 kb/s] [eta 00m:03s]
Threads: 3: [FFm] [60.0% done] [   632/     0 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [63.6% done] [   264/     0 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [   580/ 10028 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [68.4% done] [   988/     0 kb/s] [eta 00m:06s]
Threads: 3: [VFF] [77.8% done] [ 11800/     0 kb/s] [eta 00m:04s]
Threads: 3: [VFF] [83.3% done] [ 12216/     0 kb/s] [eta 00m:03s]
Threads: 3: [VFF] [88.9% done] [  4296/     0 kb/s] [eta 00m:02s]
Threads: 3: [VFF] [100.0% done] [ 14828/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [100.0% done] [  7880/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [67.9% done] [ 25764/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [69.0% done] [ 21056/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [75.0% done] [ 34388/     0 kb/s] [eta 00m:07s]
Threads: 2: [_VV] [88.0% done] [ 27206/     0 kb/s] [eta 00m:03s]
Threads: 2: [_VV] [95.8% done] [ 32480/     0 kb/s] [eta 00m:01s]
Threads: 2: [_VV] [100.0% done] [ 36640/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 26492/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=1131
  read : io=100MiB, bw=4,781KiB/s, runt= 21929msec
    slat (msec): min=   75, max=20283, avg=15789.07, stdev=3304.00
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=32023, per=82.77%, avg=9890.72, stdev=8133.27
  write: io=99,328KiB, bw=7,974KiB/s, runt= 12755msec
    slat (msec): min=    0, max=   78, avg= 2.12, stdev= 4.64
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=97461, per=212.76%, avg=32588.33, stdev=56181.58
  cpu          : usr=5.55%, sys=1.82%, ctx=781
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1132
  read : io=100MiB, bw=4,022KiB/s, runt= 26070msec
    slat (msec): min=   26, max=21169, avg=15735.01, stdev=6838.91
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=27662, per=74.48%, avg=8899.71, stdev=7836.52
  write: io=89,768KiB, bw=4,842KiB/s, runt= 18983msec
    slat (msec): min=    0, max=  215, avg= 3.65, stdev=14.07
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=80214, per=175.92%, avg=26945.80, stdev=37739.34
  cpu          : usr=5.31%, sys=1.52%, ctx=1077
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1133
  read : io=100MiB, bw=3,983KiB/s, runt= 26326msec
    slat (msec): min=   46, max=18524, avg=13897.50, stdev=5148.50
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   19, max=32816, per=61.75%, avg=7378.65, stdev=8972.63
  write: io=94,856KiB, bw=5,117KiB/s, runt= 18979msec
    slat (msec): min=    0, max=   95, avg= 2.92, stdev= 6.29
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=94983, per=258.70%, avg=39624.75, stdev=47513.23
  cpu          : usr=5.30%, sys=1.78%, ctx=1058
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,949KiB/s, minb=3,983KiB/s, maxb=4,781KiB/s, mint=21929msec, maxt=26326msec
  WRITE: io=277MiB, aggrb=15,317KiB/s, minb=4,842KiB/s, maxb=7,974KiB/s, mint=21929msec, maxt=26326msec

Disk stats (read/write):
  sda: ios=3454/2388, merge=1336/68500, ticks=86820/2329156, in_queue=2417180, util=97.61%
4.05user 1.28system 0:26.54elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2429minor)pagefaults 0swaps