fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [42.9% done] [   464/     0 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [   540/ 38432 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [70.0% done] [  7196/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [71.4% done] [ 26308/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [76.2% done] [ 30200/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [81.0% done] [ 26852/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.0% done] [ 38108/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 38207/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35587/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34804/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35320/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=16481
  read : io=100MiB, bw=4,563KiB/s, runt= 22978msec
    slat (msec): min=13009, max=22015, avg=18584.36, stdev=2275.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=19029, per=78.04%, avg=10659.00, stdev=5611.79
  write: io=100MiB, bw=7,747KiB/s, runt= 13535msec
    slat (msec): min=    0, max=   15, avg= 1.84, stdev= 2.06
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=113216, per=253.36%, avg=56608.00, stdev=80055.80
  cpu          : usr=5.38%, sys=1.79%, ctx=780
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16482
  read : io=100MiB, bw=4,621KiB/s, runt= 22689msec
    slat (msec): min=   57, max=19036, avg=14054.48, stdev=3969.80
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   22, max=13678, per=62.76%, avg=8573.06, stdev=4548.86
  write: io=93,952KiB, bw=7,098KiB/s, runt= 13554msec
    slat (msec): min=    0, max=   12, avg= 1.72, stdev= 1.91
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=27905, per=62.45%, avg=13952.50, stdev=19731.81
  cpu          : usr=5.27%, sys=1.71%, ctx=977
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16483
  read : io=100MiB, bw=4,553KiB/s, runt= 23030msec
    slat (msec): min=  158, max=21586, avg=17287.02, stdev=3264.23
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=13687, per=70.11%, avg=9575.75, stdev=4857.85
  write: io=99,432KiB, bw=7,510KiB/s, runt= 13556msec
    slat (msec): min=    0, max=   11, avg= 1.95, stdev= 2.07
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111504, per=249.53%, avg=55752.00, stdev=78845.23
  cpu          : usr=5.54%, sys=1.55%, ctx=981
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,659KiB/s, minb=4,553KiB/s, maxb=4,621KiB/s, mint=22689msec, maxt=23030msec
  WRITE: io=289MiB, aggrb=22,343KiB/s, minb=7,098KiB/s, maxb=7,747KiB/s, mint=22689msec, maxt=23030msec

Disk stats (read/write):
  sda: ios=3028/1824, merge=1409/71891, ticks=97816/1767556, in_queue=1872456, util=98.91%
3.76user 1.19system 0:23.30elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2423minor)pagefaults 0swaps