fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [12.0% done] [  6070/     0 kb/s] [eta 00m:22s]
Threads: 3: [mFF] [13.8% done] [  4681/     0 kb/s] [eta 00m:25s]
Threads: 3: [mFF] [16.7% done] [  1775/  2234 kb/s] [eta 00m:25s]
Threads: 3: [mFF] [37.5% done] [    12/ 30175 kb/s] [eta 00m:10s]
Threads: 3: [mFF] [36.8% done] [  1170/     0 kb/s] [eta 00m:12s]
Threads: 3: [FFF] [100.0% done] [     0/ 47472 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [69.2% done] [  2515/     0 kb/s] [eta 00m:04s]
Threads: 3: [FVF] [76.9% done] [  8785/     0 kb/s] [eta 00m:03s]
Threads: 3: [FVF] [84.6% done] [  8400/     0 kb/s] [eta 00m:02s]
Threads: 3: [FVF] [85.7% done] [  4972/     0 kb/s] [eta 00m:02s]
Threads: 3: [FVF] [86.7% done] [  4352/     0 kb/s] [eta 00m:02s]
Threads: 3: [FVF] [93.3% done] [  4295/     0 kb/s] [eta 00m:01s]
Threads: 3: [FVF] [93.8% done] [  6400/     0 kb/s] [eta 00m:01s]
Threads: 3: [FVF] [100.0% done] [  7964/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [100.0% done] [  8049/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [69.2% done] [ 15937/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [67.9% done] [ 22068/     0 kb/s] [eta 00m:09s]
Threads: 2: [V_V] [69.0% done] [ 31572/     0 kb/s] [eta 00m:09s]
Threads: 2: [V_V] [75.0% done] [ 26180/     0 kb/s] [eta 00m:07s]
Threads: 2: [V_V] [84.6% done] [ 32304/     0 kb/s] [eta 00m:04s]
Threads: 2: [V_V] [95.8% done] [ 34765/     0 kb/s] [eta 00m:01s]
Threads: 2: [V_V] [100.0% done] [ 27348/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 26620/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=2926
  read : io=100MiB, bw=4,143KiB/s, runt= 25304msec
    slat (msec): min=   68, max=17977, avg=13940.96, stdev=5197.02
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=27690, per=67.36%, avg=8363.09, stdev=7400.55
  write: io=78,588KiB, bw=4,316KiB/s, runt= 18644msec
    slat (msec): min=    0, max=  227, avg= 4.04, stdev=22.95
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=44603, per=99.40%, avg=15053.00, stdev=25592.56
  cpu          : usr=4.38%, sys=1.39%, ctx=1007
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2927
  read : io=100MiB, bw=5,353KiB/s, runt= 19585msec
    slat (msec): min=   63, max=18038, avg=13781.04, stdev=3842.42
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   21, max=25367, per=67.84%, avg=8422.65, stdev=6250.03
  write: io=99,188KiB, bw=12,291KiB/s, runt=  8263msec
    slat (msec): min=    0, max=   68, avg= 2.09, stdev= 3.32
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=87004, per=191.96%, avg=29071.00, stdev=50171.56
  cpu          : usr=6.74%, sys=2.04%, ctx=783
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2928
  read : io=100MiB, bw=4,138KiB/s, runt= 25338msec
    slat (msec): min=    2, max=22095, avg=16716.57, stdev=5671.71
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    1, max=23064, per=77.13%, avg=9575.39, stdev=8854.74
  write: io=97,968KiB, bw=5,782KiB/s, runt= 17349msec
    slat (msec): min=    0, max=   79, avg= 2.74, stdev= 5.64
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=96493, per=413.77%, avg=62661.00, stdev=54323.64
  cpu          : usr=5.29%, sys=1.55%, ctx=1763
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,415KiB/s, minb=4,138KiB/s, maxb=5,353KiB/s, mint=19585msec, maxt=25338msec
  WRITE: io=269MiB, aggrb=15,144KiB/s, minb=4,316KiB/s, maxb=12,291KiB/s, mint=19585msec, maxt=25338msec

Disk stats (read/write):
  sda: ios=3460/1803, merge=1203/67092, ticks=83528/2277012, in_queue=2360536, util=99.07%
3.84user 1.14system 0:25.64elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2433minor)pagefaults 0swaps