fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [42.9% done] [  9880/ 80784 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [66.7% done] [  1813/101531 kb/s] [eta 00m:02s]
Threads: 3: [FFm] [71.4% done] [   297/     0 kb/s] [eta 00m:02s]
Threads: 3: [FFm] [66.7% done] [   341/     0 kb/s] [eta 00m:03s]
Threads: 3: [FFm] [70.0% done] [   479/     0 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [   221/  2186 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [ 10456/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [68.0% done] [ 24940/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [75.0% done] [ 29284/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [79.2% done] [ 25956/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.0% done] [ 33892/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.5% done] [ 35600/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 34252/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 27092/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30084/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=24053
  read : io=100MiB, bw=4,175KiB/s, runt= 25113msec
    slat (msec): min=   64, max=21264, avg=16727.96, stdev=4906.54
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=23402, per=66.70%, avg=8355.33, stdev=6234.15
  write: io=88,992KiB, bw=5,898KiB/s, runt= 15449msec
    slat (msec): min=    0, max=   18, avg= 1.87, stdev= 2.29
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=45397, per=124.02%, avg=22698.50, stdev=32100.53
  cpu          : usr=5.19%, sys=1.56%, ctx=901
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=24054
  read : io=100MiB, bw=4,247KiB/s, runt= 24689msec
    slat (msec): min=   91, max=21528, avg=16264.81, stdev=4762.11
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=18664, per=68.62%, avg=8595.50, stdev=5909.91
  write: io=94,632KiB, bw=6,285KiB/s, runt= 15417msec
    slat (msec): min=    0, max=   15, avg= 2.14, stdev= 2.51
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=17251, per=47.13%, avg=8625.50, stdev=12198.30
  cpu          : usr=4.96%, sys=1.59%, ctx=892
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=24055
  read : io=100MiB, bw=4,196KiB/s, runt= 24984msec
    slat (msec): min=   42, max=17064, avg=11327.67, stdev=4458.65
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=20234, per=50.59%, avg=6336.41, stdev=6122.79
  write: io=92,504KiB, bw=6,132KiB/s, runt= 15446msec
    slat (msec): min=    0, max=  215, avg= 2.82, stdev= 8.93
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=74141, per=154.03%, avg=28190.40, stdev=38634.29
  cpu          : usr=5.30%, sys=1.49%, ctx=945
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,526KiB/s, minb=4,175KiB/s, maxb=4,247KiB/s, mint=24689msec, maxt=25113msec
  WRITE: io=270MiB, aggrb=18,302KiB/s, minb=5,898KiB/s, maxb=6,285KiB/s, mint=24689msec, maxt=25113msec

Disk stats (read/write):
  sda: ios=3433/2341, merge=1329/66564, ticks=92720/1728720, in_queue=1821688, util=98.23%
3.90user 1.17system 0:25.34elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2437minor)pagefaults 0swaps