fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [6.1% done] [  5296/ 40156 kb/s] [eta 00m:46s]
Threads: 3: [FmF] [6.7% done] [   856/     0 kb/s] [eta 00m:56s]
Threads: 3: [FmF] [8.6% done] [  2880/     0 kb/s] [eta 00m:53s]
Threads: 3: [FmF] [10.7% done] [  3168/     0 kb/s] [eta 00m:50s]
Threads: 3: [FmF] [30.4% done] [  1812/ 27096 kb/s] [eta 00m:16s]
Threads: 3: [FmF] [50.0% done] [  1084/ 28832 kb/s] [eta 00m:08s]
Threads: 3: [FmF] [50.0% done] [   764/     0 kb/s] [eta 00m:09s]
Threads: 3: [FmF] [52.6% done] [  1148/     0 kb/s] [eta 00m:09s]
Threads: 3: [VmF] [52.4% done] [  2804/     0 kb/s] [eta 00m:10s]
Threads: 3: [VmF] [52.2% done] [ 24092/     0 kb/s] [eta 00m:11s]
Threads: 3: [VFF] [100.0% done] [ 16296/ 22744 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [100.0% done] [ 15620/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [100.0% done] [ 18128/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [100.0% done] [ 18076/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [100.0% done] [  8648/     0 kb/s] [eta 00m:00s]
Threads: 2: [_FF] [100.0% done] [  1376/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [67.9% done] [     0/     0 kb/s] [eta 00m:09s]
Threads: 2: [_VV] [69.0% done] [ 14180/     0 kb/s] [eta 00m:09s]
Threads: 2: [_VV] [84.0% done] [ 31584/     0 kb/s] [eta 00m:04s]
Threads: 2: [_VV] [88.0% done] [ 26136/     0 kb/s] [eta 00m:03s]
Threads: 2: [_VV] [100.0% done] [ 32364/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 28012/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 28367/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=28022
  read : io=100MiB, bw=6,039KiB/s, runt= 17363msec
    slat (msec): min=10148, max=16426, avg=13073.62, stdev=1788.13
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    8, max=25810, per=131.04%, avg=15976.67, stdev=8536.68
  write: io=100MiB, bw=9,583KiB/s, runt= 10941msec
    slat (msec): min=    0, max=   12, avg= 1.92, stdev= 2.01
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=110915, per=380.08%, avg=55457.50, stdev=78428.75
  cpu          : usr=7.07%, sys=2.33%, ctx=741
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=28023
  read : io=100MiB, bw=4,107KiB/s, runt= 25528msec
    slat (msec): min=   64, max=12787, avg=8555.40, stdev=3992.82
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=20823, per=47.65%, avg=5810.03, stdev=6593.70
  write: io=78,672KiB, bw=4,186KiB/s, runt= 19243msec
    slat (msec): min=    0, max=   67, avg= 1.96, stdev= 4.85
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=101724, per=232.61%, avg=33940.00, stdev=58702.69
  cpu          : usr=4.37%, sys=1.39%, ctx=1099
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=28024
  read : io=100MiB, bw=4,064KiB/s, runt= 25800msec
    slat (msec): min=   99, max=23096, avg=19379.33, stdev=4468.95
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=28486, per=96.98%, avg=11823.40, stdev=8667.72
  write: io=93,124KiB, bw=4,959KiB/s, runt= 19229msec
    slat (msec): min=    0, max=  240, avg= 2.35, stdev=11.99
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=73980, per=223.06%, avg=32547.33, stdev=37781.90
  cpu          : usr=5.04%, sys=1.21%, ctx=906
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,192KiB/s, minb=4,064KiB/s, maxb=6,039KiB/s, mint=17363msec, maxt=25800msec
  WRITE: io=268MiB, aggrb=14,591KiB/s, minb=4,186KiB/s, maxb=9,583KiB/s, mint=17363msec, maxt=25800msec

Disk stats (read/write):
  sda: ios=3421/2538, merge=1333/65729, ticks=70912/2414316, in_queue=2521092, util=99.31%
3.70user 1.09system 0:26.06elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2440minor)pagefaults 0swaps