fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [  1644/ 70600 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [70.0% done] [ 15520/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [75.0% done] [ 32800/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [80.0% done] [ 27260/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [89.5% done] [ 28144/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 37916/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 36827/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35524/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30645/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 31744/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=19494
  read : io=100MiB, bw=4,622KiB/s, runt= 22682msec
    slat (msec): min=   33, max=20520, avg=15809.91, stdev=4053.20
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=21201, per=66.90%, avg=9257.44, stdev=5924.65
  write: io=96,312KiB, bw=7,449KiB/s, runt= 13239msec
    slat (msec): min=    0, max=  194, avg= 2.25, stdev= 7.51
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=103748, per=213.89%, avg=47526.67, stdev=52417.65
  cpu          : usr=5.50%, sys=1.64%, ctx=826
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=19495
  read : io=100MiB, bw=4,698KiB/s, runt= 22315msec
    slat (msec): min=  109, max=19578, avg=14976.31, stdev=4338.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   21, max=18331, per=63.73%, avg=8818.26, stdev=5444.19
  write: io=94,532KiB, bw=7,311KiB/s, runt= 13239msec
    slat (msec): min=    0, max=   16, avg= 1.79, stdev= 2.04
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=42382, per=95.37%, avg=21191.00, stdev=29968.60
  cpu          : usr=5.20%, sys=1.83%, ctx=856
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=19496
  read : io=100MiB, bw=4,612KiB/s, runt= 22734msec
    slat (msec): min=   10, max=20671, avg=15867.29, stdev=4133.92
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=17656, per=62.56%, avg=8655.95, stdev=5355.44
  write: io=96,792KiB, bw=7,477KiB/s, runt= 13255msec
    slat (msec): min=    0, max=   13, avg= 1.86, stdev= 2.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=108426, per=163.48%, avg=36324.67, stdev=62442.19
  cpu          : usr=5.42%, sys=1.79%, ctx=862
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,837KiB/s, minb=4,612KiB/s, maxb=4,698KiB/s, mint=22315msec, maxt=22734msec
  WRITE: io=281MiB, aggrb=22,220KiB/s, minb=7,311KiB/s, maxb=7,477KiB/s, mint=22315msec, maxt=22734msec

Disk stats (read/write):
  sda: ios=3174/1814, merge=1324/69928, ticks=69644/1622732, in_queue=1703544, util=98.91%
3.68user 1.22system 0:23.02elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2420minor)pagefaults 0swaps