fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [75.0% done] [   374/ 42432 kb/s] [eta 00m:01s]
Threads: 3: [FFF] [100.0% done] [     0/  9342 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [68.4% done] [ 14300/     0 kb/s] [eta 00m:06s]
Threads: 2: [V_V] [82.4% done] [ 31692/     0 kb/s] [eta 00m:03s]
Threads: 2: [V_V] [93.8% done] [ 32322/     0 kb/s] [eta 00m:01s]
Threads: 2: [V_V] [100.0% done] [ 36383/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 33673/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 28868/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=15524
  read : io=100MiB, bw=5,558KiB/s, runt= 18865msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  395, avg=32.26, stdev=52.56
    bw (KiB/s) : min=    8, max=28910, per=113.15%, avg=12461.53, stdev=8685.28
  write: io=97,584KiB, bw=7,888KiB/s, runt= 12668msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   82, avg= 0.80, stdev= 3.92
    bw (KiB/s) : min=    0, max=32483, per=69.41%, avg=16241.50, stdev=22968.95
  cpu          : usr=4.43%, sys=2.04%, ctx=4519
  IO depths    : 1=2.9%, 2=58.0%, 4=29.5%, 8=9.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.6%, 4=0.7%, 10=15.0%, 20=17.9%, 50=8.2%, 100=1.9%
     lat (msec): 250=6.2%, 500=0.5%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15525
  read : io=0KiB, bw=0KiB/s, runt= 12690msec
  write: io=100MiB, bw=8,290KiB/s, runt= 12648msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=    5, avg= 0.23, stdev= 0.57
    bw (KiB/s) : min=    0, max=101138, per=216.13%, avg=50569.00, stdev=71515.37
  cpu          : usr=7.34%, sys=2.84%, ctx=3093
  IO depths    : 1=2.1%, 2=96.3%, 4=1.6%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=95.9%, 4=3.2%, 10=0.3%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15526
  read : io=100MiB, bw=5,506KiB/s, runt= 19042msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1227, avg=40.92, stdev=92.29
    bw (KiB/s) : min=    5, max=25519, per=98.97%, avg=10899.47, stdev=8808.68
  write: io=90,144KiB, bw=7,270KiB/s, runt= 12697msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  815, avg= 2.32, stdev=30.69
    bw (KiB/s) : min=    0, max=23929, per=51.13%, avg=11964.50, stdev=16920.36
  cpu          : usr=3.87%, sys=2.10%, ctx=4604
  IO depths    : 1=2.6%, 2=56.5%, 4=29.4%, 8=11.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.8%, 4=0.6%, 10=11.8%, 20=17.5%, 50=10.9%, 100=3.7%
     lat (msec): 250=5.5%, 500=0.6%, 750=0.3%, 1000=0.2%, >=2000=0.1%

Run status group 0 (all jobs):
   READ: io=200MiB, aggrb=11,013KiB/s, minb=0KiB/s, maxb=5,558KiB/s, mint=12690msec, maxt=19042msec
  WRITE: io=283MiB, aggrb=23,398KiB/s, minb=7,270KiB/s, maxb=8,290KiB/s, mint=12690msec, maxt=19042msec

Disk stats (read/write):
  sda: ios=2188/1828, merge=766/70534, ticks=35464/1621172, in_queue=1665304, util=98.38%
2.57user 1.19system 0:19.37elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2441minor)pagefaults 0swaps