fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [8.8% done] [  8362/ 51529 kb/s] [eta 00m:31s]
Threads: 3: [mmF] [9.5% done] [  6192/     0 kb/s] [eta 00m:38s]
Threads: 3: [mmF] [15.6% done] [  2045/  7606 kb/s] [eta 00m:27s]
Threads: 3: [mmF] [16.2% done] [  2494/     0 kb/s] [eta 00m:31s]
Threads: 3: [mmF] [17.1% done] [  1446/   333 kb/s] [eta 00m:34s]
Threads: 3: [mmF] [18.6% done] [  3088/  2531 kb/s] [eta 00m:35s]
Threads: 3: [mmF] [19.1% done] [  1612/  9369 kb/s] [eta 00m:38s]
Threads: 3: [mmF] [20.4% done] [  1788/   612 kb/s] [eta 00m:39s]
Threads: 3: [FmF] [21.2% done] [  1628/ 16088 kb/s] [eta 00m:41s]
Threads: 3: [FmF] [22.2% done] [  1208/     0 kb/s] [eta 00m:42s]
Threads: 3: [FmF] [54.2% done] [  1296/ 46544 kb/s] [eta 00m:11s]
Threads: 3: [FmF] [60.9% done] [   592/  9608 kb/s] [eta 00m:09s]
Threads: 3: [FmF] [62.5% done] [  3224/     0 kb/s] [eta 00m:09s]
Threads: 3: [FmF] [66.7% done] [  4688/     0 kb/s] [eta 00m:08s]
Threads: 3: [FFF] [100.0% done] [  2884/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.0% done] [ 10504/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [70.0% done] [ 17104/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [78.6% done] [ 30600/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [85.2% done] [ 32876/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [88.9% done] [ 26936/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [96.2% done] [ 30160/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 33152/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 26888/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 28308/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=12298
  read : io=100MiB, bw=3,699KiB/s, runt= 28311msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  907, avg=83.99, stdev=149.63
    bw (KiB/s) : min=    9, max=15267, per=45.12%, avg=4892.85, stdev=5257.78
  write: io=91,108KiB, bw=4,741KiB/s, runt= 19676msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  699, avg= 5.32, stdev=45.62
    bw (KiB/s) : min=    0, max= 9743, per=28.49%, avg=3630.20, stdev=4221.19
  cpu          : usr=2.53%, sys=1.27%, ctx=6986
  IO depths    : 1=1.8%, 2=52.1%, 4=29.7%, 8=16.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=46.2%, 4=0.2%, 10=19.8%, 20=14.4%, 50=4.8%, 100=0.5%
     lat (msec): 250=8.0%, 500=3.7%, 750=1.6%, 1000=0.4%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12299
  read : io=100MiB, bw=3,653KiB/s, runt= 28649msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1218, avg=118.80, stdev=180.08
    bw (KiB/s) : min=   71, max= 9950, per=34.59%, avg=3750.84, stdev=2941.37
  write: io=64,244KiB, bw=3,341KiB/s, runt= 19688msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  559, avg= 7.15, stdev=48.53
    bw (KiB/s) : min=    0, max=36681, per=75.03%, avg=9561.75, stdev=18088.56
  cpu          : usr=1.80%, sys=1.31%, ctx=7110
  IO depths    : 1=0.5%, 2=39.6%, 4=31.0%, 8=28.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=36.5%, 4=0.2%, 10=6.4%, 20=11.1%, 50=21.4%, 100=4.1%
     lat (msec): 250=9.7%, 500=6.6%, 750=2.6%, 1000=0.7%, >=2000=0.3%
fio: (groupid=0): err= 0: pid=12300
  read : io=100MiB, bw=3,612KiB/s, runt= 28955msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  879, avg=60.01, stdev=110.60
    bw (KiB/s) : min=    1, max=16392, per=69.83%, avg=7572.19, stdev=5463.78
  write: io=89,684KiB, bw=4,666KiB/s, runt= 19680msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  259, avg= 1.12, stdev=12.75
    bw (KiB/s) : min=    0, max=126361, per=495.77%, avg=63180.50, stdev=89350.72
  cpu          : usr=2.57%, sys=1.08%, ctx=7017
  IO depths    : 1=0.9%, 2=49.0%, 4=32.5%, 8=17.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=44.7%, 4=1.0%, 10=14.0%, 20=16.9%, 50=11.9%, 100=1.6%
     lat (msec): 250=7.1%, 500=2.0%, 750=0.3%, 1000=0.3%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=299MiB, aggrb=10,844KiB/s, minb=3,612KiB/s, maxb=3,699KiB/s, mint=28311msec, maxt=28955msec
  WRITE: io=239MiB, aggrb=12,744KiB/s, minb=3,341KiB/s, maxb=4,741KiB/s, mint=28311msec, maxt=28955msec

Disk stats (read/write):
  sda: ios=4315/2119, merge=1141/59091, ticks=110884/2017988, in_queue=2129068, util=99.21%
2.02user 1.11system 0:29.27elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2473minor)pagefaults 0swaps