fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [42.9% done] [  1188/     0 kb/s] [eta 00m:04s]
Threads: 3: [mFF] [57.1% done] [   980/ 26332 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [     0/ 16916 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  6312/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 24148/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 32804/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.8% done] [ 26930/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.5% done] [ 36240/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 36800/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 38776/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34950/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 28724/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=16285
  read : io=100MiB, bw=4,323KiB/s, runt= 24252msec
    slat (msec): min=   34, max=20134, avg=15930.64, stdev=4123.29
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=17327, per=57.78%, avg=7494.20, stdev=6012.61
  write: io=96,596KiB, bw=6,755KiB/s, runt= 14641msec
    slat (msec): min=    0, max=   45, avg= 2.09, stdev= 3.25
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=102687, per=165.44%, avg=34278.00, stdev=59243.98
  cpu          : usr=5.33%, sys=1.57%, ctx=856
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16286
  read : io=100MiB, bw=4,379KiB/s, runt= 23941msec
    slat (msec): min=   79, max=22454, avg=17999.97, stdev=3986.18
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=22418, per=78.32%, avg=10158.59, stdev=6573.46
  write: io=97,244KiB, bw=6,801KiB/s, runt= 14641msec
    slat (msec): min=    0, max=   13, avg= 1.80, stdev= 1.98
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112480, per=271.44%, avg=56240.00, stdev=79535.37
  cpu          : usr=5.33%, sys=1.62%, ctx=815
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16287
  read : io=100MiB, bw=4,372KiB/s, runt= 23979msec
    slat (msec): min=14038, max=23006, avg=18670.45, stdev=2292.50
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   13, max=21355, per=84.31%, avg=10936.00, stdev=6521.75
  write: io=100MiB, bw=7,163KiB/s, runt= 14637msec
    slat (msec): min=    0, max=   14, avg= 2.00, stdev= 2.14
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=107251, per=258.82%, avg=53625.50, stdev=75837.91
  cpu          : usr=5.17%, sys=1.63%, ctx=796
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,971KiB/s, minb=4,323KiB/s, maxb=4,379KiB/s, mint=23941msec, maxt=24252msec
  WRITE: io=289MiB, aggrb=20,719KiB/s, minb=6,755KiB/s, maxb=7,163KiB/s, mint=23941msec, maxt=24252msec

Disk stats (read/write):
  sda: ios=3017/2580, merge=1198/71379, ticks=80828/1919100, in_queue=2000048, util=98.79%
3.85user 1.18system 0:24.52elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2426minor)pagefaults 0swaps