fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [5.0% done] [   756/   116 kb/s] [eta 00m:57s]
Threads: 3: [mmm] [6.7% done] [  4336/ 38224 kb/s] [eta 00m:56s]
Threads: 3: [mmF] [8.3% done] [  9313/ 59794 kb/s] [eta 00m:55s]
Threads: 3: [mmF] [10.0% done] [   144/     0 kb/s] [eta 00m:54s]
Threads: 3: [mmF] [11.7% done] [   212/ 29292 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [13.3% done] [    96/  1985 kb/s] [eta 00m:52s]
Threads: 3: [mFF] [15.0% done] [    32/     0 kb/s] [eta 00m:51s]
Threads: 3: [mFF] [16.7% done] [    76/     0 kb/s] [eta 00m:50s]
Threads: 3: [mFF] [18.3% done] [    56/     0 kb/s] [eta 00m:49s]
Threads: 3: [mFF] [20.0% done] [     0/     0 kb/s] [eta 00m:48s]
Threads: 3: [mVV] [23.2% done] [  3584/ 23820 kb/s] [eta 00m:43s]
Threads: 3: [mVV] [23.3% done] [ 24192/     0 kb/s] [eta 00m:46s]
Threads: 3: [mVV] [25.0% done] [ 28316/     0 kb/s] [eta 00m:45s]
Threads: 3: [mVV] [26.7% done] [ 32888/   364 kb/s] [eta 00m:44s]
Threads: 3: [mVV] [31.5% done] [ 35892/ 11212 kb/s] [eta 00m:37s]
Threads: 3: [mVV] [32.1% done] [ 23792/     0 kb/s] [eta 00m:38s]
Threads: 3: [mVV] [32.2% done] [ 13920/   436 kb/s] [eta 00m:40s]
Threads: 3: [mVV] [33.3% done] [ 19588/     0 kb/s] [eta 00m:40s]
Threads: 2: [mV_] [44.7% done] [  4600/ 17140 kb/s] [eta 00m:26s]
Threads: 1: [m__] [64.7% done] [ 15256/ 26260 kb/s] [eta 00m:12s]
Threads: 1: [F__] [100.0% done] [     0/  3672 kb/s] [eta 00m:00s]
Threads: 1: [F__] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [83.3% done] [ 23544/     0 kb/s] [eta 00m:05s]
Threads: 1: [V__] [100.0% done] [ 35744/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=30566
  read : io=100MiB, bw=3,825KiB/s, runt= 27397msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 7414, avg=88.18, stdev=440.12
    bw (KiB/s) : min=    1, max=35799, per=45.67%, avg=5242.64, stdev=11032.01
  write: io=83,044KiB, bw=3,448KiB/s, runt= 24660msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 6808, avg=32.66, stdev=314.30
    bw (KiB/s) : min=    0, max=48349, per=83.83%, avg=9588.00, stdev=16708.39
  cpu          : usr=2.26%, sys=1.62%, ctx=8721
  IO depths    : 1=1.0%, 2=49.6%, 4=32.0%, 8=17.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=45.6%, 4=1.5%, 10=18.5%, 20=19.2%, 50=8.0%, 100=1.7%
     lat (msec): 250=1.9%, 500=0.9%, 750=0.3%, 1000=0.2%, >=2000=1.2%
fio: (groupid=0): err= 0: pid=30567
  read : io=100MiB, bw=4,781KiB/s, runt= 21930msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 3010, avg=71.15, stdev=221.69
    bw (KiB/s) : min=   28, max=20955, per=62.36%, avg=7159.38, stdev=6887.11
  write: io=94,920KiB, bw=7,458KiB/s, runt= 13032msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1522, avg= 4.42, stdev=64.16
    bw (KiB/s) : min=    0, max=20915, per=91.43%, avg=10457.50, stdev=14789.14
  cpu          : usr=3.39%, sys=1.82%, ctx=7249
  IO depths    : 1=0.7%, 2=53.0%, 4=31.4%, 8=14.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.7%, 4=0.3%, 10=13.9%, 20=17.7%, 50=6.0%, 100=1.7%
     lat (msec): 250=9.3%, 500=1.2%, 750=0.4%, 1000=0.1%, >=2000=0.5%
fio: (groupid=0): err= 0: pid=30568
  read : io=100MiB, bw=5,092KiB/s, runt= 20590msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1919, avg=51.23, stdev=126.60
    bw (KiB/s) : min=   24, max=21528, per=77.07%, avg=8847.90, stdev=7919.91
  write: io=97,508KiB, bw=7,668KiB/s, runt= 13020msec
    slat (msec): min=    0, max=    1, avg= 0.00, stdev= 0.03
    clat (msec): min=    0, max= 1420, avg= 3.82, stdev=65.07
    bw (KiB/s) : min=    0, max=26776, per=78.25%, avg=8949.67, stdev=15438.10
  cpu          : usr=3.89%, sys=2.16%, ctx=7023
  IO depths    : 1=1.6%, 2=52.9%, 4=31.8%, 8=13.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.7%, 4=1.3%, 10=15.8%, 20=15.8%, 50=6.1%, 100=1.9%
     lat (msec): 250=9.2%, 500=0.4%, 750=0.1%, 1000=0.1%, >=2000=0.5%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,480KiB/s, minb=3,825KiB/s, maxb=5,092KiB/s, mint=20590msec, maxt=27397msec
  WRITE: io=269MiB, aggrb=11,438KiB/s, minb=3,448KiB/s, maxb=7,668KiB/s, mint=20590msec, maxt=27397msec

Disk stats (read/write):
  sda: ios=3497/3266, merge=1274/65260, ticks=82416/2156320, in_queue=2246284, util=97.87%
2.19user 1.34system 0:27.78elapsed 12%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2482minor)pagefaults 0swaps