fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [50.0% done] [  1508/  6500 kb/s] [eta 00m:03s]
Threads: 3: [mFm] [50.0% done] [  1272/  2580 kb/s] [eta 00m:04s]
Threads: 3: [mFm] [50.0% done] [  1264/  8608 kb/s] [eta 00m:05s]
Threads: 3: [mFm] [50.0% done] [  1212/  1664 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [50.0% done] [  1548/ 16180 kb/s] [eta 00m:07s]
Threads: 3: [FFF] [100.0% done] [   208/ 29128 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.2% done] [ 11168/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [70.4% done] [ 34920/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [74.1% done] [ 31056/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [80.8% done] [ 25296/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [88.0% done] [ 36172/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.8% done] [ 32068/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 27216/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 39452/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 33672/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=1671
  read : io=100MiB, bw=3,847KiB/s, runt= 27250msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  719, avg=74.80, stdev=145.07
    bw (KiB/s) : min=    0, max=18773, per=46.27%, avg=5341.34, stdev=6216.22
  write: io=96,608KiB, bw=5,609KiB/s, runt= 17636msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  575, avg= 3.80, stdev=34.52
    bw (KiB/s) : min=    0, max=42751, per=68.15%, avg=11522.50, stdev=20872.00
  cpu          : usr=2.86%, sys=1.31%, ctx=5748
  IO depths    : 1=1.5%, 2=55.0%, 4=30.5%, 8=13.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.8%, 4=0.3%, 10=20.8%, 20=13.4%, 50=5.2%, 100=0.5%
     lat (msec): 250=4.8%, 500=3.8%, 750=2.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1672
  read : io=100MiB, bw=3,981KiB/s, runt= 26333msec
    clat (msec): min=    0, max=  654, avg=40.45, stdev=83.16
    bw (KiB/s) : min=   14, max=20138, per=97.19%, avg=11219.13, stdev=4842.58
  write: io=100MiB, bw=5,947KiB/s, runt= 17632msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   14, avg= 0.31, stdev= 1.10
    bw (KiB/s) : min=    0, max=116416, per=344.28%, avg=58208.00, stdev=82318.54
  cpu          : usr=3.28%, sys=1.41%, ctx=5690
  IO depths    : 1=1.8%, 2=56.6%, 4=31.6%, 8=10.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.8%, 4=1.0%, 10=22.4%, 20=15.5%, 50=4.4%, 100=0.1%
     lat (msec): 250=5.5%, 500=1.1%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1673
  read : io=100MiB, bw=3,890KiB/s, runt= 26953msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  845, avg=66.03, stdev=121.72
    bw (KiB/s) : min=    7, max=19980, per=52.84%, avg=6099.43, stdev=6039.55
  write: io=92,176KiB, bw=5,360KiB/s, runt= 17608msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  614, avg= 5.05, stdev=40.17
    bw (KiB/s) : min=    0, max=129605, per=163.73%, avg=27681.60, stdev=57041.81
  cpu          : usr=2.76%, sys=1.29%, ctx=5913
  IO depths    : 1=1.5%, 2=53.9%, 4=30.4%, 8=14.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.2%, 4=0.0%, 10=18.6%, 20=14.8%, 50=5.2%, 100=1.6%
     lat (msec): 250=7.0%, 500=3.3%, 750=1.0%, 1000=0.1%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,543KiB/s, minb=3,847KiB/s, maxb=3,981KiB/s, mint=26333msec, maxt=27250msec
  WRITE: io=284MiB, aggrb=16,907KiB/s, minb=5,360KiB/s, maxb=5,947KiB/s, mint=26333msec, maxt=27250msec

Disk stats (read/write):
  sda: ios=3203/2616, merge=1123/70027, ticks=106184/2376696, in_queue=2503424, util=99.00%
2.44user 1.12system 0:27.56elapsed 12%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2489minor)pagefaults 0swaps