fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [7.9% done] [  5892/ 40260 kb/s] [eta 00m:35s]
Threads: 3: [FmF] [8.9% done] [  1572/ 50680 kb/s] [eta 00m:41s]
Threads: 3: [FmF] [9.3% done] [   820/     0 kb/s] [eta 00m:49s]
Threads: 3: [FmF] [66.7% done] [  1024/ 80528 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [     0/  6636 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [     0/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.2% done] [ 19592/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 29732/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.0% done] [ 30484/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [85.7% done] [ 28000/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.0% done] [ 35276/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 34272/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30216/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33520/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 31504/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=1285
  read : io=100MiB, bw=4,436KiB/s, runt= 23637msec
    slat (msec): min=  119, max=20275, avg=15927.27, stdev=4489.50
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=22455, per=66.59%, avg=8861.53, stdev=5186.44
  write: io=90,940KiB, bw=6,618KiB/s, runt= 14070msec
    slat (msec): min=    0, max=  207, avg= 2.05, stdev= 9.14
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=113862, per=278.88%, avg=56931.00, stdev=80512.59
  cpu          : usr=4.89%, sys=1.61%, ctx=968
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1286
  read : io=100MiB, bw=4,633KiB/s, runt= 22632msec
    slat (msec): min=   76, max=16571, avg=11850.85, stdev=4228.76
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   21, max=21401, per=56.22%, avg=7481.41, stdev=6253.21
  write: io=87,164KiB, bw=6,393KiB/s, runt= 13961msec
    slat (msec): min=    0, max=   11, avg= 1.67, stdev= 1.88
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=116216, per=284.65%, avg=58108.00, stdev=82177.12
  cpu          : usr=5.20%, sys=1.52%, ctx=1016
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1287
  read : io=100MiB, bw=4,460KiB/s, runt= 23510msec
    slat (msec): min=13434, max=22586, avg=18518.03, stdev=2591.06
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   15, max=24052, per=81.96%, avg=10906.81, stdev=6796.95
  write: io=100MiB, bw=7,533KiB/s, runt= 13918msec
    slat (msec): min=    0, max=   11, avg= 1.78, stdev= 1.98
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114826, per=281.24%, avg=57413.00, stdev=81194.24
  cpu          : usr=5.29%, sys=1.53%, ctx=739
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,308KiB/s, minb=4,436KiB/s, maxb=4,633KiB/s, mint=22632msec, maxt=23637msec
  WRITE: io=274MiB, aggrb=20,414KiB/s, minb=6,393KiB/s, maxb=7,533KiB/s, mint=22632msec, maxt=23637msec

Disk stats (read/write):
  sda: ios=3308/1967, merge=1176/68008, ticks=90216/1837288, in_queue=1937532, util=99.28%
3.60user 1.10system 0:23.89elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2416minor)pagefaults 0swaps