fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [15.8% done] [   192/     0 kb/s] [eta 00m:16s]
Threads: 3: [mFm] [15.4% done] [   292/     0 kb/s] [eta 00m:22s]
Threads: 3: [mFm] [15.6% done] [   320/     0 kb/s] [eta 00m:27s]
Threads: 3: [mFm] [15.8% done] [   496/     0 kb/s] [eta 00m:32s]
fio: ioengines.c:195: td_io_queue: Assertion `(io_u->flags & IO_U_F_FLIGHT) == 0' failed.
fio: pid=2391, got signal=6
Threads: 2: [_Fm] [15.9% done] [   564/ 53584 kb/s] [eta 00m:37s]
Threads: 2: [_Fm] [36.4% done] [   696/ 28944 kb/s] [eta 00m:14s]
Threads: 2: [_FF] [100.0% done] [     0/ 48531 kb/s] [eta 00m:00s]
Threads: 2: [_FF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [_FF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [_FF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [_FF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [_FF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [71.4% done] [  8540/     0 kb/s] [eta 00m:06s]
Threads: 2: [_VV] [80.0% done] [ 34196/     0 kb/s] [eta 00m:04s]
Threads: 2: [_VV] [89.5% done] [ 33424/     0 kb/s] [eta 00m:02s]
Threads: 2: [_VV] [100.0% done] [ 36736/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 32576/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 35572/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=2391
  cpu          : usr=0.00%, sys=0.00%, ctx=0
  IO depths    : 1=0.4%, 2=95.5%, 4=1.8%, 8=2.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=95.4%, 4=1.3%, 10=0.0%, 20=0.1%, 50=0.2%, 100=0.2%
     lat (msec): 250=1.7%, 500=0.0%, 750=0.0%, 1000=0.1%, >=2000=0.3%
fio: (groupid=0): err= 0: pid=2392
  read : io=100MiB, bw=4,989KiB/s, runt= 21017msec
    clat (msec): min=    0, max=  254, avg=28.60, stdev=44.38
    bw (KiB/s) : min=   16, max=22773, per=149.07%, avg=15195.17, stdev=6135.50
  write: io=100MiB, bw=7,137KiB/s, runt= 14692msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   10, avg= 0.24, stdev= 0.60
    bw (KiB/s) : min=    0, max=133644, per=323.78%, avg=66822.00, stdev=94500.58
  cpu          : usr=4.21%, sys=2.63%, ctx=5746
  IO depths    : 1=1.3%, 2=56.6%, 4=31.6%, 8=10.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=51.1%, 4=0.4%, 10=21.8%, 20=14.7%, 50=4.1%, 100=0.7%
     lat (msec): 250=7.0%, 500=0.1%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2393
  read : io=100MiB, bw=4,994KiB/s, runt= 20995msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 5375, avg=65.32, stdev=341.67
    bw (KiB/s) : min=    9, max=24158, per=88.71%, avg=9042.45, stdev=8913.22
  write: io=96,152KiB, bw=6,694KiB/s, runt= 14708msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  719, avg= 1.99, stdev=22.92
    bw (KiB/s) : min=    0, max=122675, per=202.34%, avg=41758.67, stdev=70087.67
  cpu          : usr=4.06%, sys=2.23%, ctx=6132
  IO depths    : 1=1.4%, 2=55.3%, 4=30.8%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=47.8%, 4=1.0%, 10=20.5%, 20=16.1%, 50=4.6%, 100=1.3%
     lat (msec): 250=7.7%, 500=0.2%, 750=0.0%, 1000=0.0%, >=2000=0.1%

Run status group 0 (all jobs):
   READ: io=204MiB, aggrb=10,193KiB/s, minb=0KiB/s, maxb=4,994KiB/s, mint=20995msec, maxt=21017msec
  WRITE: io=289MiB, aggrb=20,638KiB/s, minb=0KiB/s, maxb=7,137KiB/s, mint=20995msec, maxt=21017msec

Disk stats (read/write):
  sda: ios=2125/2851, merge=723/71076, ticks=47464/1856744, in_queue=1905948, util=97.56%
2.57user 1.33system 0:21.40elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2479minor)pagefaults 0swaps