fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [33.3% done] [  3244/ 62640 kb/s] [eta 00m:06s]
fio: ioengines.c:195: td_io_queue: Assertion `(io_u->flags & IO_U_F_FLIGHT) == 0' failed.
fio: pid=16476, got signal=6
Threads: 2: [Fm_] [33.3% done] [  3588/     0 kb/s] [eta 00m:08s]
Threads: 2: [Fm_] [35.7% done] [   884/   556 kb/s] [eta 00m:09s]
Threads: 2: [Fm_] [35.3% done] [  1344/     0 kb/s] [eta 00m:11s]
Threads: 2: [Fm_] [46.7% done] [  1200/ 16148 kb/s] [eta 00m:08s]
Threads: 2: [Fm_] [66.7% done] [   396/ 27064 kb/s] [eta 00m:04s]
Threads: 2: [Fm_] [64.3% done] [   756/     0 kb/s] [eta 00m:05s]
Threads: 2: [FF_] [100.0% done] [     4/  4112 kb/s] [eta 00m:00s]
Threads: 2: [FF_] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [FF_] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [FF_] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [FF_] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [FF_] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [69.6% done] [  7264/     0 kb/s] [eta 00m:07s]
Threads: 2: [VV_] [73.9% done] [ 29424/     0 kb/s] [eta 00m:06s]
Threads: 2: [VV_] [90.0% done] [ 26428/     0 kb/s] [eta 00m:02s]
Threads: 2: [VV_] [100.0% done] [ 35240/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [100.0% done] [ 34088/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [100.0% done] [ 28988/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=16474
  read : io=100MiB, bw=4,725KiB/s, runt= 22185msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  551, avg=32.16, stdev=63.23
    bw (KiB/s) : min=    4, max=32321, per=136.99%, avg=13509.79, stdev=9438.70
  write: io=98,128KiB, bw=6,275KiB/s, runt= 16012msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  178, avg= 0.75, stdev= 9.49
    bw (KiB/s) : min=    0, max=136151, per=385.63%, avg=68075.50, stdev=96273.30
  cpu          : usr=3.48%, sys=1.84%, ctx=5003
  IO depths    : 1=2.4%, 2=60.0%, 4=28.2%, 8=9.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=51.6%, 4=0.1%, 10=22.2%, 20=12.2%, 50=6.1%, 100=2.1%
     lat (msec): 250=4.5%, 500=0.8%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16475
  read : io=100MiB, bw=4,700KiB/s, runt= 22306msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1103, avg=64.94, stdev=123.37
    bw (KiB/s) : min=    9, max=25878, per=68.56%, avg=6761.17, stdev=8010.15
  write: io=85,852KiB, bw=5,486KiB/s, runt= 16024msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  553, avg= 6.11, stdev=41.99
    bw (KiB/s) : min=    0, max=19609, per=38.32%, avg=6764.33, stdev=9727.55
  cpu          : usr=2.96%, sys=1.88%, ctx=5000
  IO depths    : 1=1.7%, 2=51.6%, 4=30.7%, 8=15.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=46.1%, 4=0.3%, 10=17.2%, 20=15.2%, 50=6.9%, 100=2.5%
     lat (msec): 250=7.0%, 500=3.9%, 750=0.6%, 1000=0.1%, >=2000=0.1%
fio: (groupid=0): err= 0: pid=16476
  cpu          : usr=0.00%, sys=0.00%, ctx=0
  IO depths    : 1=0.1%, 2=89.7%, 4=4.3%, 8=5.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=90.5%, 4=1.3%, 10=0.1%, 20=0.0%, 50=1.7%, 100=0.4%
     lat (msec): 250=3.8%, 500=1.8%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=210MiB, aggrb=9,862KiB/s, minb=0KiB/s, maxb=4,725KiB/s, mint=0msec, maxt=22306msec
  WRITE: io=270MiB, aggrb=17,653KiB/s, minb=0KiB/s, maxb=6,275KiB/s, mint=0msec, maxt=22306msec

Disk stats (read/write):
  sda: ios=2502/2582, merge=955/66372, ticks=49908/1981312, in_queue=2031732, util=98.99%
2.22user 1.10system 0:22.63elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2483minor)pagefaults 0swaps