fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [   724/ 40684 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [70.0% done] [  1936/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [68.2% done] [ 27608/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 32752/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [77.3% done] [ 31044/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.7% done] [ 31540/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.0% done] [ 39012/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 36440/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30076/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 38612/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=15980
  read : io=100MiB, bw=4,496KiB/s, runt= 23322msec
    slat (msec): min=13625, max=21942, avg=19015.56, stdev=2260.68
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=25606, per=77.88%, avg=10504.71, stdev=6431.67
  write: io=100MiB, bw=7,297KiB/s, runt= 14368msec
    slat (msec): min=    0, max=   21, avg= 2.91, stdev= 3.62
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=62979, per=190.09%, avg=41330.33, stdev=35806.63
  cpu          : usr=7.07%, sys=1.72%, ctx=747
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15981
  read : io=100MiB, bw=4,598KiB/s, runt= 22801msec
    slat (msec): min=  212, max=20197, avg=16333.55, stdev=3255.03
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=20872, per=78.04%, avg=10525.37, stdev=6987.95
  write: io=98MiB, bw=7,147KiB/s, runt= 14368msec
    slat (msec): min=    0, max=  218, avg= 3.24, stdev= 8.40
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=62182, per=120.52%, avg=26203.75, stdev=31265.55
  cpu          : usr=7.16%, sys=2.11%, ctx=822
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15982
  read : io=100MiB, bw=4,665KiB/s, runt= 22475msec
    slat (msec): min=13118, max=21555, avg=17064.39, stdev=2417.34
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=26222, per=86.95%, avg=11727.80, stdev=7310.53
  write: io=100MiB, bw=7,634KiB/s, runt= 13735msec
    slat (msec): min=    0, max=   11, avg= 2.03, stdev= 2.00
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=113899, per=261.92%, avg=56949.50, stdev=80538.76
  cpu          : usr=5.52%, sys=1.60%, ctx=747
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,488KiB/s, minb=4,496KiB/s, maxb=4,665KiB/s, mint=22475msec, maxt=23322msec
  WRITE: io=298MiB, aggrb=21,743KiB/s, minb=7,147KiB/s, maxb=7,634KiB/s, mint=22475msec, maxt=23322msec

Disk stats (read/write):
  sda: ios=2869/2296, merge=1048/73709, ticks=65372/1790004, in_queue=1875140, util=95.62%
4.56user 1.26system 0:23.70elapsed 24%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2412minor)pagefaults 0swaps