fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [5.0% done] [  2786/ 32223 kb/s] [eta 00m:57s]
Threads: 3: [FFm] [33.3% done] [   788/109756 kb/s] [eta 00m:08s]
Threads: 3: [FFm] [50.0% done] [   544/ 25820 kb/s] [eta 00m:05s]
Threads: 3: [FFm] [50.0% done] [   756/     0 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [   228/ 25512 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  1456/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 18636/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [70.8% done] [ 34568/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [78.3% done] [ 30304/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [86.4% done] [ 29288/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [90.9% done] [ 37416/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 31904/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37640/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 38954/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 33004/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5100
  read : io=100MiB, bw=4,244KiB/s, runt= 24702msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  988, avg=52.99, stdev=123.94
    bw (KiB/s) : min=    0, max=22879, per=63.02%, avg=8025.29, stdev=6859.83
  write: io=97,600KiB, bw=6,566KiB/s, runt= 15220msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  615, avg= 1.67, stdev=25.76
    bw (KiB/s) : min=    0, max=129327, per=325.06%, avg=64663.50, stdev=91448.00
  cpu          : usr=3.22%, sys=1.51%, ctx=8098
  IO depths    : 1=2.1%, 2=57.7%, 4=29.4%, 8=10.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=51.0%, 4=0.3%, 10=24.4%, 20=12.9%, 50=3.0%, 100=0.6%
     lat (msec): 250=5.1%, 500=1.6%, 750=0.7%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5101
  read : io=100MiB, bw=4,389KiB/s, runt= 23889msec
    clat (msec): min=    0, max=  770, avg=38.46, stdev=81.80
    bw (KiB/s) : min=    0, max=16767, per=87.22%, avg=11106.33, stdev=5004.28
  write: io=100MiB, bw=6,900KiB/s, runt= 15196msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   21, avg= 0.24, stdev= 1.09
    bw (KiB/s) : min=    0, max=124923, per=313.99%, avg=62461.50, stdev=88333.90
  cpu          : usr=3.53%, sys=1.46%, ctx=7970
  IO depths    : 1=2.7%, 2=56.6%, 4=30.6%, 8=10.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=50.9%, 4=0.6%, 10=23.3%, 20=15.0%, 50=3.4%, 100=0.2%
     lat (msec): 250=5.4%, 500=0.8%, 750=0.1%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5102
  read : io=100MiB, bw=4,264KiB/s, runt= 24589msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  918, avg=69.25, stdev=144.92
    bw (KiB/s) : min=    7, max=18046, per=50.40%, avg=6417.69, stdev=5886.73
  write: io=95,680KiB, bw=6,442KiB/s, runt= 15208msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  487, avg= 2.39, stdev=26.83
    bw (KiB/s) : min=    0, max=140230, per=236.33%, avg=47013.67, stdev=80728.73
  cpu          : usr=2.88%, sys=1.77%, ctx=7776
  IO depths    : 1=1.4%, 2=54.6%, 4=30.7%, 8=13.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.0%, 4=0.2%, 10=19.6%, 20=17.1%, 50=3.9%, 100=0.2%
     lat (msec): 250=5.9%, 500=2.0%, 750=1.6%, 1000=0.4%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,734KiB/s, minb=4,244KiB/s, maxb=4,389KiB/s, mint=23889msec, maxt=24702msec
  WRITE: io=289MiB, aggrb=19,893KiB/s, minb=6,442KiB/s, maxb=6,900KiB/s, mint=23889msec, maxt=24702msec

Disk stats (read/write):
  sda: ios=3026/2245, merge=1161/71564, ticks=94752/2047772, in_queue=2142524, util=98.73%
2.40user 1.22system 0:25.13elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2475minor)pagefaults 0swaps