fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [8.6% done] [ 10093/110560 kb/s] [eta 00m:32s]
Threads: 3: [mmF] [13.3% done] [ 10657/ 37994 kb/s] [eta 00m:26s]
Threads: 3: [FmF] [14.7% done] [  2292/ 32842 kb/s] [eta 00m:29s]
Threads: 3: [FmF] [54.5% done] [   929/ 55890 kb/s] [eta 00m:05s]
Threads: 3: [FFF] [100.0% done] [   827/ 21531 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.6% done] [  9034/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 23693/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.8% done] [ 29455/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [86.4% done] [ 26750/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [87.0% done] [ 33981/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [100.0% done] [ 33398/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33441/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 29093/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 30483/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=11184
  read : io=100MiB, bw=4,166KiB/s, runt= 25169msec
    slat (msec): min=   89, max=20847, avg=15485.22, stdev=4854.54
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    1, max=17657, per=63.86%, avg=7981.67, stdev=5005.98
  write: io=89,216KiB, bw=5,847KiB/s, runt= 15622msec
    slat (msec): min=    0, max=  103, avg= 1.97, stdev= 4.89
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=34595, per=100.75%, avg=17297.50, stdev=24462.36
  cpu          : usr=4.91%, sys=1.33%, ctx=902
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=11185
  read : io=100MiB, bw=4,259KiB/s, runt= 24620msec
    slat (msec): min=   76, max=17591, avg=12327.63, stdev=5121.10
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=17062, per=54.74%, avg=6840.92, stdev=4694.17
  write: io=78,632KiB, bw=5,152KiB/s, runt= 15626msec
    slat (msec): min=    0, max=  357, avg= 1.76, stdev= 9.48
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=67821, per=131.81%, avg=22629.67, stdev=39136.86
  cpu          : usr=4.78%, sys=1.25%, ctx=999
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=11186
  read : io=100MiB, bw=4,170KiB/s, runt= 25142msec
    slat (msec): min=   11, max=21667, avg=16620.08, stdev=4403.20
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   16, max=20414, per=65.02%, avg=8126.00, stdev=5512.58
  write: io=94,152KiB, bw=6,171KiB/s, runt= 15622msec
    slat (msec): min=    0, max=   15, avg= 1.84, stdev= 1.99
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111754, per=218.40%, avg=37497.33, stdev=64309.22
  cpu          : usr=4.71%, sys=1.67%, ctx=866
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,498KiB/s, minb=4,166KiB/s, maxb=4,259KiB/s, mint=24620msec, maxt=25169msec
  WRITE: io=256MiB, aggrb=17,169KiB/s, minb=5,152KiB/s, maxb=6,171KiB/s, mint=24620msec, maxt=25169msec

Disk stats (read/write):
  sda: ios=3557/2064, merge=1509/63413, ticks=91756/1709684, in_queue=1801444, util=99.17%
3.64user 1.09system 0:25.44elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2424minor)pagefaults 0swaps