fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [5.0% done] [   224/     0 kb/s] [eta 00m:57s]
Threads: 3: [mFF] [6.7% done] [    84/     0 kb/s] [eta 00m:56s]
Threads: 3: [mFF] [8.3% done] [    96/     0 kb/s] [eta 00m:55s]
Threads: 3: [mFF] [10.0% done] [   120/     0 kb/s] [eta 00m:54s]
Threads: 3: [mFF] [11.7% done] [   152/     0 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [13.3% done] [    68/     0 kb/s] [eta 00m:52s]
Threads: 3: [mFF] [15.0% done] [    92/     0 kb/s] [eta 00m:51s]
Threads: 3: [mVV] [16.7% done] [ 10904/   336 kb/s] [eta 00m:50s]
Threads: 3: [mVV] [18.3% done] [ 33699/     0 kb/s] [eta 00m:49s]
Threads: 3: [mVV] [20.0% done] [ 32808/   673 kb/s] [eta 00m:48s]
Threads: 3: [mVV] [21.7% done] [ 33440/     0 kb/s] [eta 00m:47s]
Threads: 3: [mVV] [23.3% done] [ 33172/     0 kb/s] [eta 00m:46s]
Threads: 3: [mVV] [25.0% done] [ 31368/   456 kb/s] [eta 00m:45s]
Threads: 1: [m__] [26.7% done] [ 31764/     0 kb/s] [eta 00m:44s]
Threads: 1: [m__] [28.3% done] [ 11536/     0 kb/s] [eta 00m:43s]
Threads: 1: [m__] [30.0% done] [ 12948/     0 kb/s] [eta 00m:42s]
Threads: 1: [m__] [31.7% done] [ 11124/     0 kb/s] [eta 00m:41s]
Threads: 1: [m__] [38.5% done] [ 11228/     0 kb/s] [eta 00m:32s]
Threads: 1: [F__] [100.0% done] [   208/ 43640 kb/s] [eta 00m:00s]
Threads: 1: [F__] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [74.2% done] [  8012/     0 kb/s] [eta 00m:08s]
Threads: 1: [V__] [85.7% done] [ 18432/     0 kb/s] [eta 00m:04s]
fio: (groupid=0): err= 0: pid=30425
  read : io=100MiB, bw=4,091KiB/s, runt= 25630msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 7096, avg=99.00, stdev=494.93
    bw (KiB/s) : min=    8, max=19677, per=47.52%, avg=5830.82, stdev=6880.52
  write: io=45,104KiB, bw=2,008KiB/s, runt= 22996msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 2390, avg=20.15, stdev=189.42
    bw (KiB/s) : min=    0, max=  198, per=0.84%, avg=92.75, stdev=83.03
  cpu          : usr=1.36%, sys=1.14%, ctx=6080
  IO depths    : 1=0.8%, 2=40.5%, 4=27.8%, 8=30.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=38.4%, 4=0.1%, 10=7.3%, 20=16.4%, 50=17.4%, 100=16.1%
     lat (msec): 250=1.9%, 500=0.3%, 750=0.1%, 1000=0.2%, >=2000=0.7%
fio: (groupid=0): err= 0: pid=30426
  read : io=100MiB, bw=6,578KiB/s, runt= 15934msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  447, avg=32.85, stdev=56.95
    bw (KiB/s) : min=    3, max=21373, per=115.01%, avg=14112.79, stdev=6606.71
  write: io=99,044KiB, bw=10,698KiB/s, runt=  9480msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  428, avg= 1.35, stdev=19.13
    bw (KiB/s) : min=    0, max=129359, per=589.17%, avg=64679.50, stdev=91470.63
  cpu          : usr=5.00%, sys=2.31%, ctx=4414
  IO depths    : 1=1.4%, 2=56.4%, 4=31.2%, 8=11.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=50.5%, 4=0.2%, 10=20.8%, 20=15.4%, 50=5.0%, 100=0.2%
     lat (msec): 250=6.8%, 500=0.8%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=30427
  read : io=100MiB, bw=6,420KiB/s, runt= 16330msec
    clat (msec): min=    0, max=  484, avg=30.15, stdev=56.44
    bw (KiB/s) : min=   24, max=21780, per=111.30%, avg=13658.00, stdev=7149.02
  write: io=100MiB, bw=11,070KiB/s, runt=  9472msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   12, avg= 0.28, stdev= 0.98
    bw (KiB/s) : min=    0, max=118595, per=540.15%, avg=59297.50, stdev=83859.33
  cpu          : usr=5.22%, sys=2.16%, ctx=4581
  IO depths    : 1=2.4%, 2=57.1%, 4=30.7%, 8=9.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=50.2%, 4=0.7%, 10=23.8%, 20=14.4%, 50=3.9%, 100=0.2%
     lat (msec): 250=6.0%, 500=0.5%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,271KiB/s, minb=4,091KiB/s, maxb=6,578KiB/s, mint=15934msec, maxt=25630msec
  WRITE: io=241MiB, aggrb=10,978KiB/s, minb=2,008KiB/s, maxb=11,070KiB/s, mint=15934msec, maxt=25630msec

Disk stats (read/write):
  sda: ios=3791/2021, merge=1040/59616, ticks=87588/1391376, in_queue=1478960, util=96.14%
2.05user 1.07system 0:26.38elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2473minor)pagefaults 0swaps