fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [50.0% done] [  1020/ 84512 kb/s] [eta 00m:03s]
Threads: 3: [FFm] [50.0% done] [  1112/     0 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [     0/ 33772 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [70.0% done] [  8180/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [71.4% done] [ 28224/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 30516/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [85.0% done] [ 25508/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [94.7% done] [ 34744/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 36192/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 36456/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 28736/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37028/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=29582
  read : io=100MiB, bw=4,604KiB/s, runt= 22775msec
    slat (msec): min=   91, max=20016, avg=15642.63, stdev=3855.59
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=18544, per=66.72%, avg=9116.47, stdev=5357.91
  write: io=96,588KiB, bw=7,353KiB/s, runt= 13450msec
    slat (msec): min=    0, max=   11, avg= 1.78, stdev= 1.96
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=38497, per=88.25%, avg=19248.50, stdev=27221.49
  cpu          : usr=5.27%, sys=1.67%, ctx=901
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=29583
  read : io=100MiB, bw=4,638KiB/s, runt= 22606msec
    slat (msec): min=   18, max=21008, avg=16879.27, stdev=3635.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   17, max=18684, per=70.81%, avg=9675.06, stdev=6330.98
  write: io=98MiB, bw=7,633KiB/s, runt= 13446msec
    slat (msec): min=    0, max=   21, avg= 1.89, stdev= 2.39
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=105683, per=162.49%, avg=35443.00, stdev=60830.48
  cpu          : usr=5.61%, sys=1.50%, ctx=826
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=29584
  read : io=100MiB, bw=4,554KiB/s, runt= 23021msec
    slat (msec): min=   16, max=18618, avg=13350.83, stdev=4558.20
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=19093, per=57.65%, avg=7876.67, stdev=5503.16
  write: io=89,676KiB, bw=6,831KiB/s, runt= 13442msec
    slat (msec): min=    0, max=  175, avg= 2.66, stdev=12.51
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111791, per=171.04%, avg=37307.33, stdev=64504.78
  cpu          : usr=5.20%, sys=1.49%, ctx=1039
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,664KiB/s, minb=4,554KiB/s, maxb=4,638KiB/s, mint=22606msec, maxt=23021msec
  WRITE: io=280MiB, aggrb=21,812KiB/s, minb=6,831KiB/s, maxb=7,633KiB/s, mint=22606msec, maxt=23021msec

Disk stats (read/write):
  sda: ios=3296/1869, merge=1233/69592, ticks=75016/1654232, in_queue=1743592, util=98.93%
3.72user 1.07system 0:23.29elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2415minor)pagefaults 0swaps