fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [5.3% done] [   752/     0 kb/s] [eta 00m:54s]
Threads: 3: [FFm] [6.7% done] [  1032/     0 kb/s] [eta 00m:56s]
Threads: 3: [FFm] [8.3% done] [   712/     0 kb/s] [eta 00m:55s]
Threads: 3: [FFm] [10.0% done] [  1692/     0 kb/s] [eta 00m:54s]
Threads: 3: [FFm] [11.7% done] [   936/     0 kb/s] [eta 00m:53s]
Threads: 3: [FFm] [13.3% done] [  1700/     0 kb/s] [eta 00m:52s]
Threads: 3: [FFm] [15.0% done] [  1140/     0 kb/s] [eta 00m:51s]
Threads: 3: [VVm] [16.7% done] [  1096/     0 kb/s] [eta 00m:50s]
Threads: 3: [VVm] [45.8% done] [ 29276/ 52756 kb/s] [eta 00m:13s]
Threads: 3: [VVm] [46.2% done] [ 30520/     0 kb/s] [eta 00m:14s]
Threads: 3: [VVm] [46.4% done] [ 38260/     0 kb/s] [eta 00m:15s]
Threads: 3: [VVm] [46.7% done] [ 37176/     0 kb/s] [eta 00m:16s]
Threads: 3: [VVm] [46.9% done] [ 28095/     0 kb/s] [eta 00m:17s]
Threads: 3: [VVm] [47.1% done] [ 27216/     0 kb/s] [eta 00m:18s]
Threads: 1: [__m] [47.2% done] [ 13801/     0 kb/s] [eta 00m:19s]
Threads: 1: [__m] [47.4% done] [   640/     0 kb/s] [eta 00m:20s]
Threads: 1: [__m] [48.7% done] [  1108/     0 kb/s] [eta 00m:20s]
Threads: 1: [__m] [50.0% done] [  2572/     0 kb/s] [eta 00m:20s]
Threads: 1: [__F] [100.0% done] [  3196/ 22864 kb/s] [eta 00m:00s]
Threads: 1: [__F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [74.2% done] [  8044/     0 kb/s] [eta 00m:08s]
Threads: 1: [__V] [88.9% done] [ 25540/     0 kb/s] [eta 00m:03s]
Threads: 1: [__V] [100.0% done] [ 32792/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5136
  read : io=100MiB, bw=6,397KiB/s, runt= 16390msec
    slat (msec): min=  186, max=14817, avg=11892.49, stdev=2144.96
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=23685, per=117.26%, avg=14248.85, stdev=7479.31
  write: io=98,896KiB, bw=10,165KiB/s, runt=  9962msec
    slat (msec): min=    0, max=   11, avg= 1.82, stdev= 1.92
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112851, per=449.61%, avg=56425.50, stdev=79797.71
  cpu          : usr=7.44%, sys=2.25%, ctx=852
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5137
  read : io=100MiB, bw=6,292KiB/s, runt= 16665msec
    slat (msec): min= 9274, max=15738, avg=12346.08, stdev=1910.03
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    8, max=20939, per=120.07%, avg=14591.25, stdev=6110.36
  write: io=100MiB, bw=10,521KiB/s, runt=  9966msec
    slat (msec): min=    0, max=   22, avg= 1.85, stdev= 2.04
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=116715, per=465.00%, avg=58357.50, stdev=82529.97
  cpu          : usr=7.49%, sys=2.14%, ctx=857
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5138
  read : io=100MiB, bw=4,050KiB/s, runt= 25885msec
    slat (msec): min=   27, max= 5002, avg=3029.22, stdev=1486.68
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   74, max=33678, per=48.34%, avg=5874.14, stdev=9944.04
  write: io=75,620KiB, bw=3,427KiB/s, runt= 22593msec
    slat (msec): min=    0, max=   13, avg= 1.84, stdev= 1.97
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max= 5219, per=20.79%, avg=2609.50, stdev=3690.39
  cpu          : usr=4.56%, sys=1.13%, ctx=1456
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,152KiB/s, minb=4,050KiB/s, maxb=6,397KiB/s, mint=16390msec, maxt=25885msec
  WRITE: io=270MiB, aggrb=12,550KiB/s, minb=3,427KiB/s, maxb=10,521KiB/s, mint=16390msec, maxt=25885msec

Disk stats (read/write):
  sda: ios=3436/2152, merge=1110/66586, ticks=79472/2003988, in_queue=2110076, util=94.00%
3.69user 1.05system 0:27.25elapsed 17%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2430minor)pagefaults 0swaps