fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [7.3% done] [  1401/ 40495 kb/s] [eta 00m:38s]
Threads: 3: [mFm] [7.3% done] [   816/ 42704 kb/s] [eta 00m:51s]
Threads: 3: [mFm] [41.7% done] [   768/ 54400 kb/s] [eta 00m:07s]
Threads: 3: [FFm] [46.2% done] [   456/ 42084 kb/s] [eta 00m:07s]
Threads: 3: [FFm] [43.8% done] [     0/     0 kb/s] [eta 00m:09s]
Threads: 3: [FFm] [44.4% done] [   672/   280 kb/s] [eta 00m:10s]
Threads: 3: [FFm] [45.0% done] [     0/     0 kb/s] [eta 00m:11s]
Threads: 3: [FFm] [45.5% done] [     0/     0 kb/s] [eta 00m:12s]
Threads: 3: [FFF] [100.0% done] [   174/ 35423 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.0% done] [  3585/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [75.0% done] [ 27948/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [79.2% done] [ 31951/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.0% done] [ 29752/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.5% done] [ 34052/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35112/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35856/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 29830/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30927/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=2635
  read : io=100MiB, bw=4,082KiB/s, runt= 25684msec
    slat (msec): min=  163, max=19958, avg=15429.38, stdev=3765.63
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=15473, per=72.95%, avg=8840.25, stdev=5056.38
  write: io=94,764KiB, bw=5,833KiB/s, runt= 16634msec
    slat (msec): min=    0, max=   12, avg= 1.94, stdev= 1.95
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=15102, per=43.77%, avg=7551.00, stdev=10678.73
  cpu          : usr=4.66%, sys=1.39%, ctx=883
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2636
  read : io=100MiB, bw=4,039KiB/s, runt= 25958msec
    slat (msec): min=  109, max=22489, avg=17921.37, stdev=4539.49
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=28987, per=73.77%, avg=8939.30, stdev=6576.80
  write: io=95,968KiB, bw=5,903KiB/s, runt= 16646msec
    slat (msec): min=    0, max=  201, avg= 2.10, stdev= 7.24
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=78485, per=151.85%, avg=26194.67, stdev=45284.78
  cpu          : usr=4.36%, sys=1.68%, ctx=885
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2637
  read : io=100MiB, bw=4,089KiB/s, runt= 25639msec
    slat (msec): min=  100, max=15156, avg=10550.46, stdev=3584.71
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=12521, per=64.35%, avg=7797.68, stdev=4245.75
  write: io=89,688KiB, bw=5,519KiB/s, runt= 16638msec
    slat (msec): min=    0, max= 2937, avg= 7.49, stdev=129.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=16228, per=31.58%, avg=5447.00, stdev=9336.79
  cpu          : usr=4.56%, sys=1.64%, ctx=993
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,118KiB/s, minb=4,039KiB/s, maxb=4,089KiB/s, mint=25639msec, maxt=25958msec
  WRITE: io=274MiB, aggrb=17,250KiB/s, minb=5,519KiB/s, maxb=5,903KiB/s, mint=25639msec, maxt=25958msec

Disk stats (read/write):
  sda: ios=3364/3198, merge=1342/66815, ticks=83256/1981140, in_queue=2064400, util=99.09%
3.57user 1.28system 0:26.36elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2425minor)pagefaults 0swaps