f1: (g=0): rw=write, bs=16K-64K/16K-64K, ioengine=sync, iodepth=1
f2: (g=1): rw=randwrite, bs=16K-64K/16K-64K, ioengine=sync, iodepth=1
f3: (g=2): rw=read, bs=16K-64K/16K-64K, ioengine=sync, iodepth=1
f4: (g=3): rw=randread, bs=16K-64K/16K-64K, ioengine=sync, iodepth=1
Starting 4 processes
f1: Laying out IO file(s) (1 file(s) / 1024MiB)
f2: Laying out IO file(s) (1 file(s) / 1024MiB)
f3: Laying out IO file(s) (1 file(s) / 1024MiB)
f4: Laying out IO file(s) (1 file(s) / 1024MiB)

f1: (groupid=0, jobs=1): err= 0: pid=6312
  write: io=1,024MiB, bw=207MiB/s, iops=5,291, runt=  4956msec
    clat (usec): min=53, max=589K, avg=185.61, stdev=4122.77
    bw (KiB/s) : min=    0, max=274208, per=91.87%, avg=194403.67, stdev=98690.08
  cpu          : usr=2.24%, sys=75.65%, ctx=61, majf=0, minf=42
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=0/26223, short=0/0
     lat (usec): 100=24.79%, 250=74.43%, 500=0.69%, 750=0.01%, 1000=0.01%
     lat (msec): 2=0.01%, 4=0.04%, 10=0.01%, 20=0.01%, 100=0.01%
     lat (msec): 500=0.01%, 750=0.01%
f2: (groupid=1, jobs=1): err= 0: pid=6332
  write: io=1,024MiB, bw=240MiB/s, iops=6,196, runt=  4272msec
    clat (usec): min=48, max=487K, avg=157.70, stdev=3807.53
    bw (KiB/s) : min=    0, max=369664, per=88.62%, avg=217544.62, stdev=119704.97
  cpu          : usr=2.25%, sys=67.22%, ctx=41, majf=0, minf=43
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=0/26473, short=0/0
     lat (usec): 50=0.86%, 100=48.57%, 250=50.39%, 500=0.12%, 1000=0.01%
     lat (msec): 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 100=0.01%
     lat (msec): 250=0.01%, 500=0.01%
f3: (groupid=2, jobs=1): err= 0: pid=6595
  read : io=1,024MiB, bw=39,533KiB/s, iops=987, runt= 26524msec
    clat (usec): min=6, max=899K, avg=1009.48, stdev=15700.31
    bw (KiB/s) : min=   74, max=102501, per=119.51%, avg=47245.19, stdev=47975.63
  cpu          : usr=0.35%, sys=3.45%, ctx=4081, majf=0, minf=47
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=26192/0, short=0/0
     lat (usec): 10=23.55%, 20=26.98%, 50=33.77%, 100=0.02%, 250=0.15%
     lat (msec): 2=2.67%, 4=12.22%, 10=0.26%, 20=0.08%, 50=0.09%
     lat (msec): 100=0.05%, 250=0.05%, 500=0.07%, 750=0.03%, 1000=0.01%
f4: (groupid=3, jobs=1): err= 0: pid=6620
  read : io=76,544KiB, bw=2,551KiB/s, iops=63, runt= 30001msec
    clat (msec): min=2, max=66, avg=15.69, stdev= 6.78
    bw (KiB/s) : min= 2227, max= 3017, per=100.17%, avg=2555.22, stdev=167.15
  cpu          : usr=0.03%, sys=0.97%, ctx=18962, majf=0, minf=63
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1910/0, short=0/0

     lat (msec): 4=1.94%, 10=19.11%, 20=51.88%, 50=26.86%, 100=0.21%

Run status group 0 (all jobs):
  WRITE: io=1,024MiB, aggrb=207MiB/s, minb=207MiB/s, maxb=207MiB/s, mint=4956msec, maxt=4956msec

Run status group 1 (all jobs):
  WRITE: io=1,024MiB, aggrb=240MiB/s, minb=240MiB/s, maxb=240MiB/s, mint=4272msec, maxt=4272msec

Run status group 2 (all jobs):
   READ: io=1,024MiB, aggrb=39,533KiB/s, minb=39,533KiB/s, maxb=39,533KiB/s, mint=26524msec, maxt=26524msec

Run status group 3 (all jobs):
   READ: io=76,544KiB, aggrb=2,551KiB/s, minb=2,551KiB/s, maxb=2,551KiB/s, mint=30001msec, maxt=30001msec

Disk stats (read/write):
  sda: ios=23348/46991, merge=0/954764, ticks=87929/54817523, in_queue=54934073, util=96.14%
0.34user 16.34system 4:56.20elapsed 5%CPU (0avgtext+0avgdata 0maxresident)k
2249064inputs+8001360outputs (26major+3016minor)pagefaults 0swaps