fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [25.0% done] [   958/ 51000 kb/s] [eta 00m:09s]
Threads: 3: [FFm] [40.0% done] [   820/ 19712 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [   402/ 45088 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.6% done] [ 11459/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 35977/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [75.0% done] [ 26571/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [82.6% done] [ 28712/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.9% done] [ 37006/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.5% done] [ 34117/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 32430/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32942/     0 kb/s] [eta 00m:00s]
Threads: 2: [VVE] [100.0% done] [ 36240/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=14517
  read : io=100MiB, bw=4,251KiB/s, runt= 24653msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  866, avg=53.08, stdev=104.78
    bw (KiB/s) : min=    0, max=14970, per=62.60%, avg=7986.53, stdev=5282.25
  write: io=92,836KiB, bw=6,232KiB/s, runt= 15252msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  115, avg= 0.48, stdev= 4.92
    bw (KiB/s) : min=    0, max=127418, per=330.75%, avg=63709.00, stdev=90098.13
  cpu          : usr=3.00%, sys=1.65%, ctx=8262
  IO depths    : 1=0.9%, 2=53.4%, 4=30.4%, 8=15.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.5%, 4=4.8%, 10=13.7%, 20=20.0%, 50=3.3%, 100=1.3%
     lat (msec): 250=5.3%, 500=2.7%, 750=0.2%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14518
  read : io=100MiB, bw=4,315KiB/s, runt= 24298msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  649, avg=44.70, stdev=87.30
    bw (KiB/s) : min=    3, max=16943, per=78.69%, avg=10038.82, stdev=4483.50
  write: io=99,680KiB, bw=6,697KiB/s, runt= 15240msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  195, avg= 1.15, stdev= 8.67
    bw (KiB/s) : min=    0, max=85753, per=222.60%, avg=42876.50, stdev=60636.53
  cpu          : usr=3.72%, sys=1.79%, ctx=8384
  IO depths    : 1=2.4%, 2=50.3%, 4=32.6%, 8=14.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=47.0%, 4=3.4%, 10=15.1%, 20=23.6%, 50=2.9%, 100=0.1%
     lat (msec): 250=5.4%, 500=2.1%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14519
  read : io=100MiB, bw=4,375KiB/s, runt= 23965msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1073, avg=54.26, stdev=115.08
    bw (KiB/s) : min=    1, max=15110, per=56.82%, avg=7248.70, stdev=5638.62
  write: io=94,544KiB, bw=6,344KiB/s, runt= 15260msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  843, avg= 4.24, stdev=43.75
    bw (KiB/s) : min=    0, max=21580, per=54.09%, avg=10418.33, stdev=10809.19
  cpu          : usr=3.54%, sys=1.70%, ctx=8313
  IO depths    : 1=0.9%, 2=52.7%, 4=30.3%, 8=16.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=47.0%, 4=5.4%, 10=14.7%, 20=20.7%, 50=2.4%, 100=0.5%
     lat (msec): 250=5.7%, 500=2.7%, 750=0.6%, 1000=0.1%, >=2000=0.1%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,758KiB/s, minb=4,251KiB/s, maxb=4,375KiB/s, mint=23965msec, maxt=24653msec
  WRITE: io=280MiB, aggrb=19,262KiB/s, minb=6,232KiB/s, maxb=6,697KiB/s, mint=23965msec, maxt=24653msec

Disk stats (read/write):
  sda: ios=3164/2194, merge=1293/69239, ticks=102840/1894988, in_queue=2022336, util=97.69%
2.55user 1.31system 0:25.40elapsed 15%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2477minor)pagefaults 0swaps