fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [37.5% done] [   772/   800 kb/s] [eta 00m:05s]
Threads: 3: [FmF] [40.0% done] [  1000/   868 kb/s] [eta 00m:06s]
Threads: 3: [FmF] [38.5% done] [   848/     0 kb/s] [eta 00m:08s]
Threads: 3: [FmF] [66.7% done] [   200/ 42700 kb/s] [eta 00m:03s]
fio: ioengines.c:195: td_io_queue: Assertion `(io_u->flags & IO_U_F_FLIGHT) == 0' failed.
fio: pid=17350, got signal=6
Threads: 2: [F_F] [100.0% done] [     0/  2548 kb/s] [eta 00m:00s]
Threads: 2: [F_F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_V] [70.6% done] [  1691/     0 kb/s] [eta 00m:05s]
Threads: 2: [F_V] [81.2% done] [ 20187/     0 kb/s] [eta 00m:03s]
Threads: 2: [F_V] [93.3% done] [ 14498/     0 kb/s] [eta 00m:01s]
Threads: 2: [F_V] [100.0% done] [ 11016/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_V] [100.0% done] [  8448/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_V] [100.0% done] [ 12348/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [69.2% done] [ 25843/     0 kb/s] [eta 00m:08s]
Threads: 1: [V__] [82.6% done] [ 31776/     0 kb/s] [eta 00m:04s]
Threads: 1: [V__] [100.0% done] [ 41695/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=17349
  read : io=100MiB, bw=4,906KiB/s, runt= 21371msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  433, avg=17.27, stdev=39.07
    bw (KiB/s) : min=    1, max=44300, per=212.09%, avg=21896.67, stdev=18309.53
  write: io=99,388KiB, bw=5,670KiB/s, runt= 17948msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  179, avg= 0.79, stdev= 7.98
    bw (KiB/s) : min=    0, max=49111, per=146.67%, avg=24555.50, stdev=34726.72
  cpu          : usr=3.87%, sys=1.93%, ctx=7241
  IO depths    : 1=1.1%, 2=55.1%, 4=31.8%, 8=12.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.6%, 4=4.3%, 10=20.9%, 20=18.6%, 50=5.1%, 100=1.1%
     lat (msec): 250=0.9%, 500=0.5%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17350
  cpu          : usr=0.00%, sys=0.00%, ctx=0
  IO depths    : 1=0.2%, 2=89.3%, 4=3.1%, 8=7.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=89.4%, 4=1.1%, 10=0.0%, 20=0.1%, 50=0.4%, 100=3.0%
     lat (msec): 250=2.3%, 500=0.8%, 750=1.6%, 1000=0.9%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17351
  read : io=100MiB, bw=5,562KiB/s, runt= 18849msec
    clat (msec): min=    0, max=  433, avg=32.93, stdev=44.41
    bw (KiB/s) : min=    2, max=30126, per=127.89%, avg=13203.64, stdev=9138.60
  write: io=100MiB, bw=8,928KiB/s, runt= 11744msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=    9, avg= 0.29, stdev= 0.74
    bw (KiB/s) : min=    0, max=122019, per=364.41%, avg=61009.50, stdev=86280.46
  cpu          : usr=4.48%, sys=2.74%, ctx=6498
  IO depths    : 1=1.0%, 2=52.9%, 4=33.0%, 8=13.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.3%, 4=3.0%, 10=14.0%, 20=15.8%, 50=7.5%, 100=6.7%
     lat (msec): 250=4.1%, 500=0.3%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=210MiB, aggrb=10,324KiB/s, minb=0KiB/s, maxb=5,562KiB/s, mint=18849msec, maxt=21371msec
  WRITE: io=287MiB, aggrb=16,742KiB/s, minb=0KiB/s, maxb=8,928KiB/s, mint=18849msec, maxt=21371msec

Disk stats (read/write):
  sda: ios=2191/2619, merge=1215/70409, ticks=41784/2247564, in_queue=2317612, util=98.73%
2.42user 1.25system 0:21.70elapsed 16%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2482minor)pagefaults 0swaps