fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [37.5% done] [  7502/  6524 kb/s] [eta 00m:05s]
Threads: 3: [FFm] [50.0% done] [   445/ 46170 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [50.0% done] [  1189/  3135 kb/s] [eta 00m:05s]
Threads: 3: [FFm] [66.7% done] [   949/ 21988 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [   189/  3426 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.6% done] [ 16431/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 34048/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [75.0% done] [ 23945/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [82.6% done] [ 28104/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [91.3% done] [ 34163/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.7% done] [ 33445/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 30633/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30507/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 33437/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=17250
  read : io=100MiB, bw=4,119KiB/s, runt= 25457msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  995, avg=56.86, stdev=112.45
    bw (KiB/s) : min=    7, max=17496, per=55.77%, avg=6890.46, stdev=5267.84
  write: io=95,928KiB, bw=6,267KiB/s, runt= 15672msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   44, avg= 0.70, stdev= 3.20
    bw (KiB/s) : min=    0, max=14325, per=38.84%, avg=7162.50, stdev=10129.30
  cpu          : usr=3.41%, sys=1.54%, ctx=5567
  IO depths    : 1=4.9%, 2=55.0%, 4=29.1%, 8=11.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.1%, 4=0.3%, 10=15.3%, 20=17.9%, 50=7.2%, 100=1.7%
     lat (msec): 250=6.9%, 500=1.9%, 750=0.3%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17251
  read : io=100MiB, bw=4,260KiB/s, runt= 24609msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  715, avg=51.83, stdev=79.16
    bw (KiB/s) : min=    7, max=25493, per=70.91%, avg=8761.68, stdev=6905.64
  write: io=95,608KiB, bw=6,246KiB/s, runt= 15672msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   23, avg= 1.22, stdev= 3.75
    bw (KiB/s) : min=    0, max=89088, per=197.54%, avg=36426.33, stdev=46710.36
  cpu          : usr=3.51%, sys=1.92%, ctx=5488
  IO depths    : 1=5.7%, 2=47.9%, 4=32.5%, 8=14.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=42.9%, 4=0.7%, 10=13.1%, 20=14.4%, 50=15.0%, 100=4.7%
     lat (msec): 250=7.0%, 500=1.9%, 750=0.1%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17252
  read : io=100MiB, bw=4,210KiB/s, runt= 24903msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  939, avg=72.63, stdev=122.77
    bw (KiB/s) : min=   15, max=20786, per=49.57%, avg=6124.45, stdev=5583.34
  write: io=90,696KiB, bw=5,930KiB/s, runt= 15660msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  479, avg= 4.37, stdev=28.02
    bw (KiB/s) : min=    0, max=23463, per=70.25%, avg=12954.60, stdev=11099.54
  cpu          : usr=2.94%, sys=1.70%, ctx=5141
  IO depths    : 1=2.6%, 2=53.0%, 4=30.2%, 8=14.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=44.8%, 4=0.4%, 10=11.5%, 20=16.7%, 50=11.0%, 100=2.3%
     lat (msec): 250=9.3%, 500=3.0%, 750=0.8%, 1000=0.2%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,356KiB/s, minb=4,119KiB/s, maxb=4,260KiB/s, mint=24609msec, maxt=25457msec
  WRITE: io=276MiB, aggrb=18,440KiB/s, minb=5,930KiB/s, maxb=6,267KiB/s, mint=24609msec, maxt=25457msec

Disk stats (read/write):
  sda: ios=3614/2286, merge=1341/68104, ticks=76776/1786348, in_queue=1867292, util=97.85%
2.52user 1.34system 0:26.03elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2471minor)pagefaults 0swaps