fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [7.1% done] [  9802/ 33287 kb/s] [eta 00m:39s]
Threads: 3: [FFm] [25.0% done] [  6923/129906 kb/s] [eta 00m:12s]
Threads: 3: [FFm] [26.3% done] [  1063/     0 kb/s] [eta 00m:14s]
Threads: 3: [FFm] [27.3% done] [  1253/     0 kb/s] [eta 00m:16s]
Threads: 3: [FFm] [63.6% done] [   586/ 55713 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [     0/  4681 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.0% done] [ 12745/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 21604/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [79.2% done] [ 32868/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.0% done] [ 34480/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [87.5% done] [ 27913/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.7% done] [ 31800/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 33568/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 28708/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 32452/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5155
  read : io=100MiB, bw=4,173KiB/s, runt= 25126msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  435, avg=52.37, stdev=85.79
    bw (KiB/s) : min=    2, max=13279, per=64.62%, avg=7759.71, stdev=4773.85
  write: io=91,348KiB, bw=5,561KiB/s, runt= 16820msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  186, avg= 1.30, stdev=10.50
    bw (KiB/s) : min=    0, max=52621, per=164.12%, avg=26618.33, stdev=26315.90
  cpu          : usr=2.83%, sys=1.31%, ctx=5768
  IO depths    : 1=2.4%, 2=54.1%, 4=30.7%, 8=12.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=47.9%, 4=0.8%, 10=16.8%, 20=18.0%, 50=5.2%, 100=1.6%
     lat (msec): 250=7.3%, 500=2.3%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5156
  read : io=100MiB, bw=4,032KiB/s, runt= 26006msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  618, avg=57.00, stdev=97.16
    bw (KiB/s) : min=    3, max=19655, per=64.00%, avg=7685.43, stdev=4984.33
  write: io=88,944KiB, bw=5,413KiB/s, runt= 16824msec
    slat (msec): min=    0, max=    1, avg= 0.00, stdev= 0.03
    clat (msec): min=    0, max=  230, avg= 1.10, stdev=11.78
    bw (KiB/s) : min=    0, max=37852, per=116.69%, avg=18926.00, stdev=26765.41
  cpu          : usr=2.75%, sys=1.75%, ctx=5814
  IO depths    : 1=1.9%, 2=55.3%, 4=29.9%, 8=12.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=50.1%, 4=0.5%, 10=14.5%, 20=18.3%, 50=4.8%, 100=1.1%
     lat (msec): 250=7.2%, 500=2.8%, 750=0.4%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5157
  read : io=100MiB, bw=3,993KiB/s, runt= 26162msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  933, avg=74.33, stdev=136.68
    bw (KiB/s) : min=   17, max=18125, per=49.63%, avg=5960.14, stdev=5296.41
  write: io=86,192KiB, bw=5,248KiB/s, runt= 16816msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  534, avg= 2.76, stdev=30.10
    bw (KiB/s) : min=    0, max= 7449, per=22.96%, avg=3724.50, stdev=5267.24
  cpu          : usr=2.57%, sys=1.25%, ctx=5856
  IO depths    : 1=2.0%, 2=54.9%, 4=29.1%, 8=14.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.2%, 4=0.4%, 10=12.4%, 20=19.8%, 50=5.1%, 100=0.7%
     lat (msec): 250=7.1%, 500=3.4%, 750=1.3%, 1000=0.2%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,009KiB/s, minb=3,993KiB/s, maxb=4,173KiB/s, mint=25126msec, maxt=26162msec
  WRITE: io=260MiB, aggrb=16,219KiB/s, minb=5,248KiB/s, maxb=5,561KiB/s, mint=25126msec, maxt=26162msec

Disk stats (read/write):
  sda: ios=3686/1944, merge=1233/64569, ticks=89436/1744080, in_queue=1839932, util=99.01%
2.12user 1.17system 0:26.56elapsed 12%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2473minor)pagefaults 0swaps