fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [50.0% done] [  1108/  7824 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [   577/ 35897 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [69.2% done] [  1952/     0 kb/s] [eta 00m:04s]
Threads: 3: [FVF] [76.9% done] [  9104/     0 kb/s] [eta 00m:03s]
Threads: 3: [FVF] [78.6% done] [  7024/     0 kb/s] [eta 00m:03s]
Threads: 3: [FVF] [92.3% done] [ 11996/     0 kb/s] [eta 00m:01s]
Threads: 3: [FVF] [100.0% done] [ 17072/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [100.0% done] [ 18156/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [100.0% done] [ 15204/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [100.0% done] [ 12244/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_F] [100.0% done] [  7100/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [70.4% done] [  9100/     0 kb/s] [eta 00m:08s]
Threads: 2: [V_V] [80.0% done] [ 29328/     0 kb/s] [eta 00m:05s]
Threads: 2: [V_V] [91.3% done] [ 30820/     0 kb/s] [eta 00m:02s]
Threads: 2: [V_V] [100.0% done] [ 38752/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 36388/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 29416/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=31913
  read : io=100MiB, bw=4,130KiB/s, runt= 25387msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  401, avg=35.28, stdev=59.31
    bw (KiB/s) : min=    2, max=22355, per=96.47%, avg=11952.25, stdev=7111.30
  write: io=97,384KiB, bw=5,297KiB/s, runt= 18824msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   75, avg= 1.85, stdev= 5.46
    bw (KiB/s) : min=    0, max=128278, per=298.78%, avg=47541.33, stdev=70286.98
  cpu          : usr=3.51%, sys=1.53%, ctx=5259
  IO depths    : 1=3.6%, 2=54.8%, 4=31.4%, 8=10.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=45.3%, 4=0.2%, 10=21.5%, 20=18.3%, 50=5.5%, 100=1.7%
     lat (msec): 250=6.6%, 500=0.8%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=31914
  read : io=100MiB, bw=6,043KiB/s, runt= 17349msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  316, avg=42.11, stdev=51.66
    bw (KiB/s) : min=   14, max=22232, per=86.80%, avg=10755.11, stdev=6446.48
  write: io=99,864KiB, bw=11,489KiB/s, runt=  8900msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  167, avg= 0.70, stdev= 6.56
    bw (KiB/s) : min=    0, max=39540, per=124.25%, avg=19770.00, stdev=27959.00
  cpu          : usr=5.51%, sys=2.42%, ctx=4472
  IO depths    : 1=1.6%, 2=55.9%, 4=30.7%, 8=11.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=47.6%, 4=2.9%, 10=10.7%, 20=13.4%, 50=11.8%, 100=6.5%
     lat (msec): 250=6.4%, 500=0.4%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=31915
  read : io=100MiB, bw=4,142KiB/s, runt= 25310msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  642, avg=42.79, stdev=75.73
    bw (KiB/s) : min=    7, max=22779, per=82.28%, avg=10194.47, stdev=8028.22
  write: io=95,268KiB, bw=5,184KiB/s, runt= 18816msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  335, avg= 0.99, stdev=13.51
    bw (KiB/s) : min=    0, max=17718, per=55.67%, avg=8859.00, stdev=12528.52
  cpu          : usr=3.10%, sys=1.34%, ctx=5460
  IO depths    : 1=2.3%, 2=56.9%, 4=29.1%, 8=11.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.5%, 4=0.7%, 10=17.1%, 20=16.0%, 50=5.7%, 100=1.7%
     lat (msec): 250=7.7%, 500=1.2%, 750=0.2%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,390KiB/s, minb=4,130KiB/s, maxb=6,043KiB/s, mint=17349msec, maxt=25387msec
  WRITE: io=286MiB, aggrb=15,912KiB/s, minb=5,184KiB/s, maxb=11,489KiB/s, mint=17349msec, maxt=25387msec

Disk stats (read/write):
  sda: ios=3199/2207, merge=1393/70650, ticks=60116/2348060, in_queue=2462920, util=97.10%
2.68user 1.20system 0:25.70elapsed 15%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2473minor)pagefaults 0swaps