fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [30.0% done] [  9764/ 42428 kb/s] [eta 00m:07s]
Threads: 3: [mFm] [33.3% done] [  9852/     0 kb/s] [eta 00m:08s]
Threads: 3: [mFm] [38.5% done] [  9948/     0 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [50.0% done] [  2764/ 65692 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [53.8% done] [   940/   164 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [66.7% done] [   712/ 18704 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [     0/  5520 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.0% done] [  1716/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 22728/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [76.0% done] [ 28968/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [83.3% done] [ 25780/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [87.5% done] [ 27692/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.7% done] [ 36180/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 33792/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 24916/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 28988/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=17163
  read : io=100MiB, bw=3,952KiB/s, runt= 26529msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  727, avg=77.73, stdev=114.09
    bw (KiB/s) : min=    8, max=18489, per=48.10%, avg=5703.22, stdev=4449.40
  write: io=80,060KiB, bw=4,779KiB/s, runt= 17152msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  349, avg= 2.22, stdev=21.08
    bw (KiB/s) : min=    0, max= 9845, per=34.73%, avg=5304.33, stdev=4966.73
  cpu          : usr=3.17%, sys=1.79%, ctx=8315
  IO depths    : 1=1.2%, 2=49.3%, 4=30.5%, 8=19.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=40.8%, 4=4.5%, 10=16.1%, 20=15.2%, 50=4.8%, 100=2.2%
     lat (msec): 250=11.8%, 500=3.9%, 750=0.5%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17164
  read : io=100MiB, bw=4,015KiB/s, runt= 26114msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  527, avg=50.11, stdev=85.77
    bw (KiB/s) : min=   10, max=21094, per=73.86%, avg=8757.21, stdev=6823.16
  write: io=96,300KiB, bw=5,750KiB/s, runt= 17148msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  155, avg= 0.70, stdev= 5.55
    bw (KiB/s) : min=    0, max=25710, per=84.17%, avg=12855.00, stdev=18179.72
  cpu          : usr=3.03%, sys=1.62%, ctx=8171
  IO depths    : 1=1.0%, 2=54.0%, 4=31.7%, 8=13.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.3%, 4=1.2%, 10=17.1%, 20=17.6%, 50=4.8%, 100=1.5%
     lat (msec): 250=6.7%, 500=2.6%, 750=0.1%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17165
  read : io=100MiB, bw=3,970KiB/s, runt= 26409msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1047, avg=66.07, stdev=109.36
    bw (KiB/s) : min=    5, max=17529, per=56.90%, avg=6746.63, stdev=5066.85
  write: io=79,456KiB, bw=4,745KiB/s, runt= 17144msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   59, avg= 0.63, stdev= 2.87
    bw (KiB/s) : min=    0, max= 6388, per=20.91%, avg=3194.00, stdev=4517.00
  cpu          : usr=3.15%, sys=1.42%, ctx=8192
  IO depths    : 1=0.8%, 2=49.0%, 4=30.6%, 8=19.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=41.4%, 4=3.8%, 10=13.7%, 20=17.1%, 50=6.7%, 100=4.3%
     lat (msec): 250=9.8%, 500=2.4%, 750=0.2%, 1000=0.2%, >=2000=0.1%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,857KiB/s, minb=3,952KiB/s, maxb=4,015KiB/s, mint=26114msec, maxt=26529msec
  WRITE: io=250MiB, aggrb=15,272KiB/s, minb=4,745KiB/s, maxb=5,750KiB/s, mint=26114msec, maxt=26529msec

Disk stats (read/write):
  sda: ios=3767/2238, merge=1371/61682, ticks=87004/2093476, in_queue=2180800, util=97.37%
2.52user 1.34system 0:26.80elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2474minor)pagefaults 0swaps