fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [5.1% done] [   880/   992 kb/s] [eta 00m:56s]
Threads: 3: [mFF] [6.7% done] [   948/     0 kb/s] [eta 00m:56s]
Threads: 3: [mFF] [8.3% done] [   572/     0 kb/s] [eta 00m:55s]
Threads: 3: [mFF] [10.0% done] [   584/  5436 kb/s] [eta 00m:54s]
Threads: 3: [mFF] [11.7% done] [   625/     0 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [13.3% done] [   980/     0 kb/s] [eta 00m:52s]
Threads: 3: [mFF] [15.0% done] [  1244/     0 kb/s] [eta 00m:51s]
Threads: 3: [mFF] [16.7% done] [   952/   656 kb/s] [eta 00m:50s]
Threads: 3: [mVV] [18.3% done] [  2844/   536 kb/s] [eta 00m:49s]
Threads: 3: [mVV] [20.0% done] [ 21280/     0 kb/s] [eta 00m:48s]
Threads: 3: [mVV] [21.7% done] [ 29300/   808 kb/s] [eta 00m:47s]
Threads: 3: [mVV] [23.3% done] [ 26744/     0 kb/s] [eta 00m:46s]
Threads: 3: [mVV] [25.0% done] [ 36300/   244 kb/s] [eta 00m:45s]
Threads: 3: [mVV] [26.7% done] [ 34764/     0 kb/s] [eta 00m:44s]
Threads: 3: [mVV] [28.3% done] [ 30181/   248 kb/s] [eta 00m:43s]
Threads: 1: [m__] [30.0% done] [ 25896/     0 kb/s] [eta 00m:42s]
Threads: 1: [m__] [31.7% done] [ 11948/   424 kb/s] [eta 00m:41s]
Threads: 1: [m__] [33.3% done] [ 10952/     0 kb/s] [eta 00m:40s]
Threads: 1: [m__] [61.8% done] [  8860/ 33416 kb/s] [eta 00m:13s]
fio: ioengines.c:195: td_io_queue: Assertion `(io_u->flags & IO_U_F_FLIGHT) == 0' failed.
fio: pid=2211, got signal=6

fio: (groupid=0): err= 0: pid=2211
  cpu          : usr=0.00%, sys=0.00%, ctx=0
  IO depths    : 1=0.3%, 2=64.5%, 4=8.1%, 8=27.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=64.8%, 4=0.0%, 10=0.1%, 20=0.3%, 50=8.6%, 100=13.4%
     lat (msec): 250=3.4%, 500=2.0%, 750=1.9%, 1000=2.3%, >=2000=3.2%
fio: (groupid=0): err= 0: pid=2212
  read : io=100MiB, bw=5,807KiB/s, runt= 18054msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  422, avg=34.99, stdev=62.24
    bw (KiB/s) : min=   16, max=25835, per=89.56%, avg=12728.64, stdev=7015.19
  write: io=98,608KiB, bw=9,159KiB/s, runt= 11024msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  159, avg= 0.59, stdev= 6.91
    bw (KiB/s) : min=    0, max=127107, per=270.80%, avg=63553.50, stdev=89878.22
  cpu          : usr=4.50%, sys=1.86%, ctx=4595
  IO depths    : 1=1.7%, 2=57.5%, 4=29.6%, 8=11.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=50.7%, 4=0.4%, 10=20.3%, 20=13.5%, 50=7.2%, 100=1.4%
     lat (msec): 250=5.5%, 500=0.9%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2213
  read : io=100MiB, bw=5,695KiB/s, runt= 18409msec
    clat (msec): min=    0, max=  471, avg=34.41, stdev=65.41
    bw (KiB/s) : min=   21, max=22491, per=87.95%, avg=12498.77, stdev=7859.63
  write: io=100MiB, bw=9,511KiB/s, runt= 11024msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=    8, avg= 0.22, stdev= 0.65
    bw (KiB/s) : min=    0, max=133627, per=284.69%, avg=66813.50, stdev=94488.56
  cpu          : usr=4.35%, sys=2.19%, ctx=4507
  IO depths    : 1=1.2%, 2=57.0%, 4=31.7%, 8=10.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=50.6%, 4=0.4%, 10=21.5%, 20=14.8%, 50=5.5%, 100=1.1%
     lat (msec): 250=4.8%, 500=1.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=250MiB, aggrb=14,212KiB/s, minb=0KiB/s, maxb=5,807KiB/s, mint=18054msec, maxt=18409msec
  WRITE: io=247MiB, aggrb=23,469KiB/s, minb=0KiB/s, maxb=9,511KiB/s, mint=18054msec, maxt=18409msec

Disk stats (read/write):
  sda: ios=2802/1785, merge=779/53405, ticks=72964/1418456, in_queue=1510336, util=98.01%
2.03user 1.03system 0:22.07elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2477minor)pagefaults 0swaps