fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [5.8% done] [  1599/     0 kb/s] [eta 00m:49s]
Threads: 3: [mFF] [6.7% done] [   807/     0 kb/s] [eta 00m:56s]
Threads: 3: [mFF] [8.3% done] [     0/     0 kb/s] [eta 00m:55s]
Threads: 3: [mFF] [10.0% done] [   815/     0 kb/s] [eta 00m:54s]
Threads: 3: [mFF] [11.7% done] [   882/     0 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [13.3% done] [   594/     0 kb/s] [eta 00m:52s]
Threads: 3: [mFF] [47.4% done] [  1126/ 55559 kb/s] [eta 00m:10s]
Threads: 3: [mFF] [47.6% done] [  1332/     0 kb/s] [eta 00m:11s]
Threads: 3: [mFF] [47.8% done] [  1244/     0 kb/s] [eta 00m:12s]
Threads: 3: [mFF] [48.0% done] [  1102/     0 kb/s] [eta 00m:13s]
Threads: 3: [mVV] [48.1% done] [ 15608/     0 kb/s] [eta 00m:14s]
Threads: 3: [mVV] [50.0% done] [ 30491/     0 kb/s] [eta 00m:14s]
Threads: 3: [FVV] [88.2% done] [ 25316/ 27143 kb/s] [eta 00m:02s]
Threads: 3: [FVV] [94.1% done] [ 27277/     0 kb/s] [eta 00m:01s]
Threads: 3: [FVV] [100.0% done] [ 30164/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [100.0% done] [ 24820/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [100.0% done] [ 27120/     0 kb/s] [eta 00m:00s]
Threads: 1: [F__] [100.0% done] [ 18983/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [75.0% done] [  9822/     0 kb/s] [eta 00m:07s]
Threads: 1: [V__] [95.7% done] [ 32618/     0 kb/s] [eta 00m:01s]
Threads: 1: [V__] [100.0% done] [ 34296/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=27720
  read : io=100MiB, bw=4,373KiB/s, runt= 23978msec
    slat (msec): min=   62, max= 8549, avg=6565.75, stdev=2347.62
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=37636, per=67.37%, avg=8837.85, stdev=13682.69
  write: io=83,996KiB, bw=4,050KiB/s, runt= 21234msec
    slat (msec): min=    0, max=  238, avg= 3.35, stdev=19.37
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=87412, per=211.87%, avg=29147.00, stdev=50458.97
  cpu          : usr=5.05%, sys=1.58%, ctx=1125
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=27721
  read : io=100MiB, bw=5,189KiB/s, runt= 20207msec
    slat (msec): min=   36, max=18765, avg=15234.79, stdev=3013.83
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=27422, per=96.97%, avg=12721.36, stdev=7772.34
  write: io=98,876KiB, bw=8,130KiB/s, runt= 12453msec
    slat (msec): min=    0, max=   35, avg= 2.02, stdev= 2.81
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=107688, per=391.39%, avg=53844.00, stdev=76146.92
  cpu          : usr=6.10%, sys=1.66%, ctx=877
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=27722
  read : io=100MiB, bw=5,117KiB/s, runt= 20489msec
    slat (msec): min=11997, max=19520, avg=15735.08, stdev=1965.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   13, max=24466, per=101.54%, avg=13321.00, stdev=7304.24
  write: io=100MiB, bw=8,422KiB/s, runt= 12449msec
    slat (msec): min=    0, max=   12, avg= 1.96, stdev= 1.98
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112852, per=410.16%, avg=56426.00, stdev=79798.41
  cpu          : usr=6.17%, sys=1.89%, ctx=760
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,119KiB/s, minb=4,373KiB/s, maxb=5,189KiB/s, mint=20207msec, maxt=23978msec
  WRITE: io=279MiB, aggrb=13,757KiB/s, minb=4,050KiB/s, maxb=8,422KiB/s, mint=20207msec, maxt=23978msec

Disk stats (read/write):
  sda: ios=3303/2220, merge=1161/68672, ticks=72672/2151340, in_queue=2335048, util=97.92%
3.75user 1.12system 0:24.32elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2420minor)pagefaults 0swaps