fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [8.1% done] [ 12272/     0 kb/s] [eta 00m:34s]
Threads: 3: [mmF] [13.3% done] [ 11433/ 87764 kb/s] [eta 00m:26s]
Threads: 3: [mmF] [45.5% done] [  4485/ 42035 kb/s] [eta 00m:06s]
Threads: 3: [mmF] [46.2% done] [  7530/     0 kb/s] [eta 00m:07s]
Threads: 3: [mmF] [50.0% done] [  8751/     0 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [53.3% done] [  3316/ 26513 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [52.9% done] [   827/     0 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [52.6% done] [  1098/     0 kb/s] [eta 00m:09s]
Threads: 3: [FFF] [100.0% done] [   315/ 22500 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.0% done] [  1048/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 18108/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [73.1% done] [ 25408/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [80.0% done] [ 23720/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.0% done] [ 28732/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [91.7% done] [ 31390/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.8% done] [ 30700/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 29268/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 21964/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=13802
  read : io=100MiB, bw=3,945KiB/s, runt= 26575msec
    slat (msec): min=   57, max=15776, avg=9175.34, stdev=5462.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=14716, per=45.33%, avg=5365.66, stdev=4414.83
  write: io=78,656KiB, bw=4,726KiB/s, runt= 17042msec
    slat (msec): min=    0, max=  136, avg= 2.32, stdev= 7.91
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=91213, per=213.27%, avg=30414.67, stdev=52652.90
  cpu          : usr=4.32%, sys=1.31%, ctx=1182
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13803
  read : io=100MiB, bw=3,975KiB/s, runt= 26373msec
    slat (msec): min=   39, max=18747, avg=11588.33, stdev=6511.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   24, max=17087, per=52.16%, avg=6174.11, stdev=3869.16
  write: io=69,620KiB, bw=4,182KiB/s, runt= 17046msec
    slat (msec): min=    0, max=  132, avg= 2.28, stdev=10.31
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=80964, per=189.33%, avg=27001.00, stdev=46733.33
  cpu          : usr=3.99%, sys=1.33%, ctx=1183
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13804
  read : io=100MiB, bw=3,965KiB/s, runt= 26444msec
    slat (msec): min=   80, max=22510, avg=17164.86, stdev=5087.80
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=18002, per=70.23%, avg=8313.38, stdev=5321.53
  write: io=89,136KiB, bw=5,355KiB/s, runt= 17042msec
    slat (msec): min=    0, max=   15, avg= 1.69, stdev= 1.94
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114092, per=400.01%, avg=57046.00, stdev=80675.23
  cpu          : usr=4.49%, sys=1.26%, ctx=891
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,837KiB/s, minb=3,945KiB/s, maxb=3,975KiB/s, mint=26373msec, maxt=26575msec
  WRITE: io=232MiB, aggrb=14,261KiB/s, minb=4,182KiB/s, maxb=5,355KiB/s, mint=26373msec, maxt=26575msec

Disk stats (read/write):
  sda: ios=4099/1855, merge=1729/57507, ticks=100732/1804372, in_queue=1905112, util=99.36%
3.44user 1.03system 0:26.84elapsed 16%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2421minor)pagefaults 0swaps