fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [25.0% done] [  8802/ 59978 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [28.6% done] [  8219/ 48167 kb/s] [eta 00m:10s]
Threads: 3: [mmF] [29.4% done] [  3130/ 15355 kb/s] [eta 00m:12s]
Threads: 3: [mmF] [30.0% done] [  1858/  5391 kb/s] [eta 00m:14s]
Threads: 3: [mmF] [30.4% done] [  2012/   296 kb/s] [eta 00m:16s]
Threads: 3: [mmF] [30.8% done] [  2134/ 13170 kb/s] [eta 00m:18s]
Threads: 3: [mmF] [32.1% done] [  2004/   441 kb/s] [eta 00m:19s]
Threads: 3: [mmF] [37.0% done] [  2134/ 25147 kb/s] [eta 00m:17s]
Threads: 3: [mmF] [37.9% done] [  1583/  1831 kb/s] [eta 00m:18s]
Threads: 3: [mmF] [38.7% done] [  4206/     0 kb/s] [eta 00m:19s]
Threads: 3: [mmF] [39.4% done] [  4418/   590 kb/s] [eta 00m:20s]
Threads: 3: [mFF] [40.0% done] [  3131/   634 kb/s] [eta 00m:21s]
Threads: 3: [FFF] [100.0% done] [     0/ 40885 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [67.7% done] [  3776/     0 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [68.8% done] [ 19971/     0 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [67.6% done] [ 31929/     0 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [72.7% done] [ 25139/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [75.8% done] [ 24993/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [81.2% done] [ 27376/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [87.1% done] [ 25094/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [93.3% done] [ 26699/     0 kb/s] [eta 00m:02s]
Threads: 1: [V__] [100.0% done] [ 31409/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=6382
  read : io=100MiB, bw=3,509KiB/s, runt= 29873msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1491, avg=101.41, stdev=203.60
    bw (KiB/s) : min=    0, max=32382, per=41.55%, avg=4371.51, stdev=6766.01
  write: io=78,320KiB, bw=3,911KiB/s, runt= 20504msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  906, avg=10.55, stdev=69.18
    bw (KiB/s) : min=    0, max= 6765, per=12.44%, avg=1492.29, stdev=2401.92
  cpu          : usr=2.32%, sys=1.10%, ctx=6022
  IO depths    : 1=3.0%, 2=53.3%, 4=27.2%, 8=16.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=43.7%, 4=1.7%, 10=13.7%, 20=19.9%, 50=6.1%, 100=0.7%
     lat (msec): 250=5.7%, 500=5.0%, 750=1.9%, 1000=0.8%, >=2000=0.6%
fio: (groupid=0): err= 0: pid=6383
  read : io=100MiB, bw=3,679KiB/s, runt= 28414msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  720, avg=95.03, stdev=136.34
    bw (KiB/s) : min=    4, max=15996, per=41.08%, avg=4321.15, stdev=4152.86
  write: io=72,364KiB, bw=3,611KiB/s, runt= 20516msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  487, avg= 7.02, stdev=44.37
    bw (KiB/s) : min=    0, max=16608, per=58.68%, avg=7041.80, stdev=6573.26
  cpu          : usr=2.37%, sys=1.18%, ctx=5965
  IO depths    : 1=1.7%, 2=42.8%, 4=31.6%, 8=23.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=35.9%, 4=2.0%, 10=6.9%, 20=13.5%, 50=18.8%, 100=3.1%
     lat (msec): 250=11.4%, 500=6.3%, 750=1.8%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=6384
  read : io=100MiB, bw=3,645KiB/s, runt= 28762msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  584, avg=53.53, stdev=92.28
    bw (KiB/s) : min=   14, max=18513, per=80.07%, avg=8423.05, stdev=5863.65
  write: io=89,748KiB, bw=4,482KiB/s, runt= 20504msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  303, avg= 1.52, stdev=15.73
    bw (KiB/s) : min=    0, max=125403, per=385.14%, avg=46216.33, stdev=68896.74
  cpu          : usr=2.60%, sys=1.11%, ctx=5991
  IO depths    : 1=2.9%, 2=57.1%, 4=28.2%, 8=11.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.6%, 4=0.4%, 10=11.5%, 20=20.7%, 50=5.8%, 100=1.8%
     lat (msec): 250=7.1%, 500=2.7%, 750=0.2%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=10,520KiB/s, minb=3,509KiB/s, maxb=3,679KiB/s, mint=28414msec, maxt=29873msec
  WRITE: io=235MiB, aggrb=12,000KiB/s, minb=3,611KiB/s, maxb=4,482KiB/s, mint=28414msec, maxt=29873msec

Disk stats (read/write):
  sda: ios=4354/2154, merge=1214/57860, ticks=96256/2219612, in_queue=2327592, util=97.95%
2.14user 1.03system 0:30.28elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2483minor)pagefaults 0swaps