fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [   926/ 94794 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [     0/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.2% done] [ 12999/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 34482/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 31301/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.8% done] [ 27314/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [86.4% done] [ 38176/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.2% done] [ 31512/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 31036/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 36014/     0 kb/s] [eta 00m:00s]
Threads: 2: [VVE] [100.0% done] [ 37806/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=14507
  read : io=100MiB, bw=4,444KiB/s, runt= 23593msec
    slat (msec): min=   51, max=20839, avg=17157.43, stdev=4358.31
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=20399, per=61.26%, avg=8167.65, stdev=5565.21
  write: io=93,684KiB, bw=6,898KiB/s, runt= 13906msec
    slat (msec): min=    0, max=   11, avg= 1.58, stdev= 1.81
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=117778, per=270.23%, avg=58889.00, stdev=83281.62
  cpu          : usr=5.04%, sys=1.81%, ctx=947
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14508
  read : io=100MiB, bw=4,533KiB/s, runt= 23127msec
    slat (msec): min=   72, max=21325, avg=16650.38, stdev=3408.08
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    8, max=19685, per=72.67%, avg=9689.50, stdev=5231.71
  write: io=98MiB, bw=7,375KiB/s, runt= 13915msec
    slat (msec): min=    0, max=   77, avg= 2.23, stdev= 4.72
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=91879, per=141.42%, avg=30819.33, stdev=52880.01
  cpu          : usr=5.38%, sys=1.94%, ctx=941
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14509
  read : io=100MiB, bw=4,560KiB/s, runt= 22995msec
    slat (msec): min=13468, max=22066, avg=18069.07, stdev=2393.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=17957, per=84.01%, avg=11201.64, stdev=5131.37
  write: io=100MiB, bw=7,531KiB/s, runt= 13923msec
    slat (msec): min=    0, max=   12, avg= 1.92, stdev= 2.15
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111732, per=256.36%, avg=55866.00, stdev=79006.45
  cpu          : usr=5.41%, sys=1.65%, ctx=892
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,333KiB/s, minb=4,444KiB/s, maxb=4,560KiB/s, mint=22995msec, maxt=23593msec
  WRITE: io=289MiB, aggrb=21,792KiB/s, minb=6,898KiB/s, maxb=7,531KiB/s, mint=22995msec, maxt=23593msec

Disk stats (read/write):
  sda: ios=3026/1785, merge=1123/72037, ticks=108300/1813096, in_queue=1954384, util=98.49%
3.73user 1.31system 0:23.94elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps