fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [8.3% done] [  2252/ 23201 kb/s] [eta 00m:33s]
Threads: 3: [mmF] [9.5% done] [  2075/     0 kb/s] [eta 00m:38s]
Threads: 3: [mmF] [10.2% done] [  1988/  3505 kb/s] [eta 00m:44s]
Threads: 3: [mmF] [10.9% done] [  2473/     0 kb/s] [eta 00m:49s]
Threads: 3: [mFF] [11.7% done] [  3749/  5986 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [24.2% done] [  1996/ 17662 kb/s] [eta 00m:25s]
Threads: 3: [FFF] [100.0% done] [     0/ 64385 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  3396/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [70.8% done] [ 16937/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [75.0% done] [ 31247/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [82.6% done] [ 32416/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.9% done] [ 30089/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.7% done] [ 30235/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35875/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 28867/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37301/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5160
  read : io=100MiB, bw=4,100KiB/s, runt= 25458msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1758, avg=84.66, stdev=187.03
    bw (KiB/s) : min=    3, max=13824, per=47.25%, avg=5719.33, stdev=4496.82
  write: io=83,192KiB, bw=5,222KiB/s, runt= 16312msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1198, avg= 2.22, stdev=43.36
    bw (KiB/s) : min=    0, max=128729, per=245.50%, avg=43072.33, stdev=74181.25
  cpu          : usr=2.86%, sys=1.46%, ctx=5564
  IO depths    : 1=2.6%, 2=56.1%, 4=28.6%, 8=12.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.6%, 4=0.2%, 10=13.9%, 20=16.9%, 50=6.5%, 100=1.7%
     lat (msec): 250=5.8%, 500=2.7%, 750=1.3%, 1000=0.6%, >=2000=0.4%
fio: (groupid=0): err= 0: pid=5161
  read : io=100MiB, bw=4,109KiB/s, runt= 25515msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  947, avg=69.20, stdev=134.34
    bw (KiB/s) : min=   24, max=20096, per=50.20%, avg=6075.79, stdev=5676.82
  write: io=93,904KiB, bw=5,896KiB/s, runt= 16308msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  471, avg= 2.43, stdev=25.15
    bw (KiB/s) : min=    0, max=25736, per=53.93%, avg=9461.75, stdev=11802.69
  cpu          : usr=2.92%, sys=1.25%, ctx=5703
  IO depths    : 1=2.3%, 2=53.6%, 4=30.7%, 8=13.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=47.2%, 4=0.4%, 10=12.7%, 20=17.6%, 50=9.7%, 100=1.4%
     lat (msec): 250=6.7%, 500=2.8%, 750=0.9%, 1000=0.5%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5162
  read : io=100MiB, bw=4,040KiB/s, runt= 25949msec
    clat (msec): min=    0, max=  683, avg=45.71, stdev=93.76
    bw (KiB/s) : min=    4, max=17038, per=78.15%, avg=9459.56, stdev=5348.41
  write: io=100MiB, bw=6,444KiB/s, runt= 16272msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   13, avg= 0.28, stdev= 0.77
    bw (KiB/s) : min=    0, max=113647, per=323.87%, avg=56823.50, stdev=80360.56
  cpu          : usr=3.48%, sys=1.36%, ctx=5605
  IO depths    : 1=3.9%, 2=58.3%, 4=29.4%, 8=8.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=51.0%, 4=1.2%, 10=16.9%, 20=18.0%, 50=5.7%, 100=0.3%
     lat (msec): 250=4.5%, 500=2.0%, 750=0.4%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,104KiB/s, minb=4,040KiB/s, maxb=4,109KiB/s, mint=25458msec, maxt=25949msec
  WRITE: io=273MiB, aggrb=17,545KiB/s, minb=5,222KiB/s, maxb=6,444KiB/s, mint=25458msec, maxt=25949msec

Disk stats (read/write):
  sda: ios=3482/2093, merge=1180/67743, ticks=112828/2110148, in_queue=2222980, util=98.56%
2.43user 1.11system 0:26.35elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2470minor)pagefaults 0swaps