fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [7.9% done] [  7541/ 74461 kb/s] [eta 00m:35s]
Threads: 3: [mmF] [44.4% done] [  1315/ 75216 kb/s] [eta 00m:05s]
Threads: 3: [mFF] [45.5% done] [   854/ 12803 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [   634/ 36052 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.6% done] [  9322/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.0% done] [ 30739/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 30523/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 25675/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [83.3% done] [ 32559/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [91.3% done] [ 30337/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 35710/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35001/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 35016/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=16038
  read : io=100MiB, bw=4,185KiB/s, runt= 25051msec
    slat (msec): min=   84, max=19258, avg=15324.04, stdev=4816.88
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=25194, per=53.00%, avg=6655.30, stdev=6595.78
  write: io=92,972KiB, bw=6,125KiB/s, runt= 15543msec
    slat (msec): min=    0, max=   11, avg= 1.77, stdev= 1.94
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=12011, per=32.82%, avg=6005.50, stdev=8493.06
  cpu          : usr=5.01%, sys=1.28%, ctx=1008
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16039
  read : io=100MiB, bw=4,386KiB/s, runt= 23906msec
    slat (msec): min=   76, max=19783, avg=14660.74, stdev=4562.01
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=16843, per=69.48%, avg=8724.32, stdev=4920.51
  write: io=89,396KiB, bw=5,888KiB/s, runt= 15547msec
    slat (msec): min=    0, max=   12, avg= 1.65, stdev= 1.85
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114860, per=313.86%, avg=57430.00, stdev=81218.28
  cpu          : usr=4.70%, sys=1.54%, ctx=1014
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16040
  read : io=100MiB, bw=4,264KiB/s, runt= 24589msec
    slat (msec): min=  175, max=21979, avg=17625.61, stdev=4096.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=21169, per=76.86%, avg=9651.88, stdev=5816.78
  write: io=95,588KiB, bw=6,292KiB/s, runt= 15555msec
    slat (msec): min=    0, max=   11, avg= 1.87, stdev= 1.96
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112992, per=308.76%, avg=56496.00, stdev=79897.41
  cpu          : usr=4.80%, sys=1.64%, ctx=990
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,557KiB/s, minb=4,185KiB/s, maxb=4,386KiB/s, mint=23906msec, maxt=25051msec
  WRITE: io=271MiB, aggrb=18,298KiB/s, minb=5,888KiB/s, maxb=6,292KiB/s, mint=23906msec, maxt=25051msec

Disk stats (read/write):
  sda: ios=3389/1853, merge=1356/67625, ticks=105788/1721584, in_queue=1830924, util=98.53%
3.59user 1.11system 0:25.59elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2419minor)pagefaults 0swaps