fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.5% done] [  8505/ 55806 kb/s] [eta 00m:23s]
Threads: 3: [Fmm] [13.8% done] [  7220/  2649 kb/s] [eta 00m:25s]
Threads: 3: [FFm] [55.6% done] [  2364/ 57360 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [66.7% done] [   365/ 23153 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [     0/   938 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  8846/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [73.9% done] [ 31305/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [78.3% done] [ 28363/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [82.6% done] [ 22206/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [87.0% done] [ 31857/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.5% done] [ 35721/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 34470/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 28525/     0 kb/s] [eta 00m:00s]
Threads: 2: [VEV] [100.0% done] [ 28700/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=14577
  read : io=100MiB, bw=4,215KiB/s, runt= 24874msec
    slat (msec): min=   31, max=21423, avg=17116.98, stdev=4522.48
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=22124, per=63.47%, avg=8026.38, stdev=6537.30
  write: io=96,700KiB, bw=6,483KiB/s, runt= 15273msec
    slat (msec): min=    0, max=   40, avg= 2.57, stdev= 4.34
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=104490, per=199.17%, avg=36129.40, stdev=50220.77
  cpu          : usr=5.32%, sys=1.50%, ctx=852
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14578
  read : io=100MiB, bw=4,368KiB/s, runt= 24002msec
    slat (msec): min=    0, max=19901, avg=12877.22, stdev=6317.34
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=22371, per=63.32%, avg=8007.29, stdev=6683.16
  write: io=94,488KiB, bw=6,316KiB/s, runt= 15318msec
    slat (msec): min=    0, max=   24, avg= 2.50, stdev= 3.00
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=78815, per=217.24%, avg=39407.50, stdev=55730.62
  cpu          : usr=5.52%, sys=1.52%, ctx=1080
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14579
  read : io=100MiB, bw=4,239KiB/s, runt= 24732msec
    slat (msec): min=   79, max=18814, avg=12848.87, stdev=5042.84
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=19003, per=54.33%, avg=6870.76, stdev=5053.84
  write: io=80,180KiB, bw=5,375KiB/s, runt= 15273msec
    slat (msec): min=    0, max=  127, avg= 2.00, stdev= 8.54
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=94161, per=173.94%, avg=31553.33, stdev=54220.40
  cpu          : usr=4.80%, sys=1.23%, ctx=1007
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,646KiB/s, minb=4,215KiB/s, maxb=4,368KiB/s, mint=24002msec, maxt=24874msec
  WRITE: io=265MiB, aggrb=18,140KiB/s, minb=5,375KiB/s, maxb=6,483KiB/s, mint=24002msec, maxt=24874msec

Disk stats (read/write):
  sda: ios=3592/1963, merge=1396/65840, ticks=73740/1721680, in_queue=1795920, util=99.06%
3.88user 1.04system 0:25.14elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2441minor)pagefaults 0swaps