fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [5.0% done] [   438/ 26420 kb/s] [eta 00m:57s]
Threads: 3: [Fmm] [30.8% done] [   577/ 39866 kb/s] [eta 00m:09s]
Threads: 3: [Fmm] [45.5% done] [  1974/ 21341 kb/s] [eta 00m:06s]
fio: ioengines.c:195: td_io_queue: Assertion `(io_u->flags & IO_U_F_FLIGHT) == 0' failed.
fio: pid=9575, got signal=6
Threads: 2: [F_m] [50.0% done] [   150/ 34962 kb/s] [eta 00m:06s]
Threads: 2: [F_m] [50.0% done] [    16/     0 kb/s] [eta 00m:07s]
Threads: 2: [F_m] [53.3% done] [   979/   142 kb/s] [eta 00m:07s]
Threads: 2: [F_m] [52.9% done] [   195/     0 kb/s] [eta 00m:08s]
Threads: 2: [F_m] [52.6% done] [   117/     0 kb/s] [eta 00m:09s]
Threads: 2: [F_m] [52.4% done] [   166/     0 kb/s] [eta 00m:10s]
Threads: 2: [F_m] [52.2% done] [   130/     0 kb/s] [eta 00m:11s]
Threads: 2: [F_m] [52.0% done] [   113/   182 kb/s] [eta 00m:12s]
Threads: 2: [F_m] [51.9% done] [    48/   182 kb/s] [eta 00m:13s]
Threads: 2: [F_m] [51.7% done] [   125/     0 kb/s] [eta 00m:14s]
Threads: 1: [__m] [55.2% done] [  4929/   125 kb/s] [eta 00m:13s]
Threads: 1: [__F] [100.0% done] [   300/ 18383 kb/s] [eta 00m:00s]
Threads: 1: [__V] [69.2% done] [  1987/     0 kb/s] [eta 00m:08s]
Threads: 1: [__V] [90.5% done] [ 29094/     0 kb/s] [eta 00m:02s]
Threads: 1: [__V] [100.0% done] [ 37026/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=9574
  read : io=0KiB, bw=0KiB/s, runt= 15456msec
  write: io=100MiB, bw=6,798KiB/s, runt= 15424msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=    4, avg= 0.18, stdev= 0.41
    bw (KiB/s) : min=    0, max=134397, per=409.35%, avg=67198.50, stdev=95033.03
  cpu          : usr=5.23%, sys=2.10%, ctx=5137
  IO depths    : 1=0.2%, 2=97.6%, 4=2.1%, 8=0.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=98.6%, 4=0.7%, 10=0.1%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=9575
  cpu          : usr=0.00%, sys=0.00%, ctx=0
  IO depths    : 1=0.2%, 2=92.1%, 4=3.2%, 8=4.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=93.5%, 4=0.5%, 10=0.2%, 20=0.0%, 50=0.1%, 100=1.1%
     lat (msec): 250=2.4%, 500=0.8%, 750=0.5%, 1000=0.3%, >=2000=0.5%
fio: (groupid=0): err= 0: pid=9576
  read : io=100MiB, bw=4,998KiB/s, runt= 20942msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 4495, avg=71.09, stdev=334.31
    bw (KiB/s) : min=   18, max=37499, per=131.44%, avg=7072.76, stdev=12722.93
  write: io=89,760KiB, bw=5,140KiB/s, runt= 17880msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 3991, avg=17.27, stdev=184.56
    bw (KiB/s) : min=    0, max=25211, per=29.57%, avg=4853.88, stdev=9400.27
  cpu          : usr=3.21%, sys=2.08%, ctx=7435
  IO depths    : 1=0.5%, 2=48.6%, 4=30.8%, 8=20.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=45.2%, 4=2.8%, 10=12.4%, 20=23.3%, 50=9.1%, 100=2.6%
     lat (msec): 250=1.9%, 500=0.4%, 750=0.4%, 1000=0.3%, >=2000=0.7%

Run status group 0 (all jobs):
   READ: io=107MiB, aggrb=5,381KiB/s, minb=0KiB/s, maxb=4,998KiB/s, mint=20942msec, maxt=20942msec
  WRITE: io=280MiB, aggrb=16,416KiB/s, minb=0KiB/s, maxb=6,798KiB/s, mint=20942msec, maxt=20942msec

Disk stats (read/write):
  sda: ios=1528/3711, merge=462/67714, ticks=32068/2131504, in_queue=2163896, util=97.73%
2.24user 1.04system 0:21.34elapsed 15%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2479minor)pagefaults 0swaps