fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [42.9% done] [ 10016/ 12483 kb/s] [eta 00m:04s]
Threads: 3: [mmF] [50.0% done] [  6564/ 45365 kb/s] [eta 00m:04s]
Threads: 3: [mmF] [50.0% done] [  6538/     0 kb/s] [eta 00m:05s]
Threads: 3: [FFF] [100.0% done] [  1909/ 30057 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [66.7% done] [     0/     0 kb/s] [eta 00m:07s]
Threads: 3: [FFV] [75.0% done] [  9090/     0 kb/s] [eta 00m:05s]
Threads: 3: [FFV] [80.0% done] [  6477/     0 kb/s] [eta 00m:04s]
Threads: 3: [FFV] [81.0% done] [  6712/     0 kb/s] [eta 00m:04s]
Threads: 3: [FFV] [90.0% done] [  9508/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [67.9% done] [ 24616/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [69.0% done] [ 32995/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [77.8% done] [ 29712/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [88.0% done] [ 26416/     0 kb/s] [eta 00m:03s]
Threads: 2: [VV_] [92.0% done] [ 34779/     0 kb/s] [eta 00m:02s]
Threads: 2: [VV_] [100.0% done] [ 30606/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [100.0% done] [ 24328/     0 kb/s] [eta 00m:00s]
Threads: 1: [_V_] [100.0% done] [ 31829/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=15712
  read : io=100MiB, bw=4,065KiB/s, runt= 25794msec
    slat (msec): min=    0, max=20609, avg=13640.50, stdev=7415.11
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=23093, per=76.36%, avg=9181.20, stdev=7848.69
  write: io=89,832KiB, bw=5,049KiB/s, runt= 18216msec
    slat (msec): min=    0, max=   41, avg= 2.77, stdev= 2.32
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=113152, per=398.81%, avg=59642.33, stdev=56824.74
  cpu          : usr=5.41%, sys=1.43%, ctx=1358
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15713
  read : io=100MiB, bw=4,007KiB/s, runt= 26163msec
    slat (msec): min=   71, max=20689, avg=15170.36, stdev=6598.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   17, max=20080, per=61.89%, avg=7441.24, stdev=5740.38
  write: io=84,416KiB, bw=4,750KiB/s, runt= 18195msec
    slat (msec): min=    0, max=   17, avg= 1.93, stdev= 2.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=14070, per=47.04%, avg=7035.00, stdev=9948.99
  cpu          : usr=4.65%, sys=1.15%, ctx=1171
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15714
  read : io=100MiB, bw=4,600KiB/s, runt= 22794msec
    slat (msec): min=   55, max=19511, avg=14659.10, stdev=4304.65
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=21594, per=72.30%, avg=8692.10, stdev=6267.33
  write: io=91,792KiB, bw=6,807KiB/s, runt= 13808msec
    slat (msec): min=    0, max=   60, avg= 2.43, stdev= 4.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=65332, per=146.20%, avg=21864.33, stdev=37644.33
  cpu          : usr=5.93%, sys=1.79%, ctx=1002
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,023KiB/s, minb=4,007KiB/s, maxb=4,600KiB/s, mint=22794msec, maxt=26163msec
  WRITE: io=260MiB, aggrb=14,955KiB/s, minb=4,750KiB/s, maxb=6,807KiB/s, mint=22794msec, maxt=26163msec

Disk stats (read/write):
  sda: ios=3966/1978, merge=1211/64445, ticks=73292/2083332, in_queue=2159724, util=97.65%
3.99user 1.08system 0:26.44elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2411minor)pagefaults 0swaps