fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [10.0% done] [  6616/ 33156 kb/s] [eta 00m:27s]
Threads: 3: [mFF] [36.4% done] [  1204/ 37608 kb/s] [eta 00m:07s]
Threads: 3: [FFF] [100.0% done] [     0/ 48244 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.4% done] [  1248/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [70.0% done] [ 22688/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [75.0% done] [ 28908/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [80.0% done] [ 25952/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [89.5% done] [ 32996/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [94.7% done] [ 34744/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35124/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32308/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 28952/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 33160/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=14964
  read : io=100MiB, bw=4,613KiB/s, runt= 22730msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1010, avg=60.74, stdev=112.32
    bw (KiB/s) : min=    0, max=16019, per=51.64%, avg=7146.29, stdev=4829.74
  write: io=85,852KiB, bw=6,731KiB/s, runt= 13060msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  235, avg= 0.62, stdev= 8.56
    bw (KiB/s) : min=    0, max=128909, per=294.26%, avg=64454.50, stdev=91152.43
  cpu          : usr=3.03%, sys=1.97%, ctx=7508
  IO depths    : 1=1.3%, 2=54.9%, 4=29.5%, 8=14.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.9%, 4=0.3%, 10=18.6%, 20=13.9%, 50=4.5%, 100=1.8%
     lat (msec): 250=9.3%, 500=1.7%, 750=0.6%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14965
  read : io=100MiB, bw=4,762KiB/s, runt= 22017msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  590, avg=53.27, stdev=92.75
    bw (KiB/s) : min=   16, max=19154, per=57.83%, avg=8002.85, stdev=6279.43
  write: io=93,968KiB, bw=7,358KiB/s, runt= 13076msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  315, avg= 2.06, stdev=18.07
    bw (KiB/s) : min=    0, max=41513, per=101.91%, avg=22322.00, stdev=20932.86
  cpu          : usr=3.29%, sys=2.31%, ctx=7087
  IO depths    : 1=1.2%, 2=52.3%, 4=32.6%, 8=13.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=47.6%, 4=0.8%, 10=17.2%, 20=17.1%, 50=4.8%, 100=2.4%
     lat (msec): 250=6.3%, 500=3.4%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14966
  read : io=100MiB, bw=4,640KiB/s, runt= 22590msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  614, avg=45.19, stdev=87.10
    bw (KiB/s) : min=    8, max=24100, per=71.55%, avg=9901.61, stdev=7107.27
  write: io=99,888KiB, bw=7,834KiB/s, runt= 13056msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  283, avg= 0.94, stdev=12.54
    bw (KiB/s) : min=    0, max=130064, per=296.90%, avg=65032.00, stdev=91969.14
  cpu          : usr=3.38%, sys=2.00%, ctx=7397
  IO depths    : 1=1.6%, 2=56.0%, 4=31.4%, 8=11.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=50.2%, 4=0.6%, 10=22.3%, 20=13.7%, 50=3.3%, 100=2.1%
     lat (msec): 250=5.1%, 500=2.2%, 750=0.2%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,838KiB/s, minb=4,613KiB/s, maxb=4,762KiB/s, mint=22017msec, maxt=22730msec
  WRITE: io=273MiB, aggrb=21,904KiB/s, minb=6,731KiB/s, maxb=7,834KiB/s, mint=22017msec, maxt=22730msec

Disk stats (read/write):
  sda: ios=3296/1526, merge=1615/68183, ticks=75140/1575476, in_queue=1683880, util=98.73%
2.23user 1.46system 0:23.07elapsed 16%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2470minor)pagefaults 0swaps