fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [6.8% done] [   252/     0 kb/s] [eta 00m:41s]
Threads: 3: [mFm] [6.9% done] [   104/ 60588 kb/s] [eta 00m:54s]
Threads: 3: [mFm] [8.3% done] [   152/     0 kb/s] [eta 00m:55s]
Threads: 3: [mFF] [10.0% done] [   236/  3804 kb/s] [eta 00m:54s]
Threads: 3: [mFF] [11.7% done] [   148/     0 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [13.3% done] [     0/     0 kb/s] [eta 00m:52s]
Threads: 3: [mFF] [15.0% done] [   192/     0 kb/s] [eta 00m:51s]
Threads: 3: [mFF] [16.7% done] [    36/     0 kb/s] [eta 00m:50s]
Threads: 3: [mFF] [18.3% done] [    60/     0 kb/s] [eta 00m:49s]
Threads: 3: [mVV] [20.0% done] [  2592/     0 kb/s] [eta 00m:48s]
Threads: 3: [mVV] [21.7% done] [ 26548/   412 kb/s] [eta 00m:47s]
Threads: 3: [mVV] [23.3% done] [ 32632/     0 kb/s] [eta 00m:46s]
Threads: 3: [mVV] [25.0% done] [ 30364/     0 kb/s] [eta 00m:45s]
Threads: 3: [mVV] [26.7% done] [ 37152/   212 kb/s] [eta 00m:44s]
Threads: 3: [mVV] [28.3% done] [ 25312/     0 kb/s] [eta 00m:43s]
Threads: 2: [mEV] [30.0% done] [ 32680/     0 kb/s] [eta 00m:42s]
Threads: 1: [m__] [31.7% done] [ 17912/     0 kb/s] [eta 00m:41s]
Threads: 1: [m__] [54.1% done] [  5804/ 53444 kb/s] [eta 00m:17s]
Threads: 1: [m__] [60.0% done] [  9840/     0 kb/s] [eta 00m:14s]
fio: ioengines.c:195: td_io_queue: Assertion `(io_u->flags & IO_U_F_FLIGHT) == 0' failed.
fio: pid=5070, got signal=6

fio: (groupid=0): err= 0: pid=5070
  cpu          : usr=0.00%, sys=0.00%, ctx=0
  IO depths    : 1=0.2%, 2=63.6%, 4=9.3%, 8=26.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=64.1%, 4=0.2%, 10=0.1%, 20=1.6%, 50=19.4%, 100=9.1%
     lat (msec): 250=1.0%, 500=0.7%, 750=0.2%, 1000=0.5%, >=2000=1.1%
fio: (groupid=0): err= 0: pid=5071
  read : io=100MiB, bw=5,689KiB/s, runt= 18430msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  315, avg=33.33, stdev=45.31
    bw (KiB/s) : min=    7, max=23887, per=93.16%, avg=12222.93, stdev=7217.47
  write: io=97,352KiB, bw=8,315KiB/s, runt= 11988msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=    6, avg= 0.40, stdev= 0.82
    bw (KiB/s) : min=    0, max=69255, per=156.54%, avg=34627.50, stdev=48970.68
  cpu          : usr=5.47%, sys=2.97%, ctx=6210
  IO depths    : 1=1.0%, 2=50.8%, 4=33.6%, 8=14.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=43.5%, 4=4.0%, 10=15.9%, 20=16.5%, 50=10.6%, 100=1.9%
     lat (msec): 250=7.2%, 500=0.2%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5072
  read : io=100MiB, bw=5,527KiB/s, runt= 18969msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1891, avg=49.48, stdev=138.06
    bw (KiB/s) : min=    6, max=23170, per=65.06%, avg=8535.78, stdev=8273.46
  write: io=97,528KiB, bw=8,330KiB/s, runt= 11988msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1787, avg= 7.91, stdev=94.01
    bw (KiB/s) : min=    0, max=123904, per=151.52%, avg=33517.50, stdev=60445.03
  cpu          : usr=5.46%, sys=2.40%, ctx=6322
  IO depths    : 1=1.1%, 2=54.2%, 4=31.3%, 8=13.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=45.5%, 4=4.3%, 10=16.0%, 20=16.3%, 50=7.1%, 100=1.4%
     lat (msec): 250=7.9%, 500=0.5%, 750=0.2%, 1000=0.1%, >=2000=0.6%

Run status group 0 (all jobs):
   READ: io=237MiB, aggrb=13,120KiB/s, minb=0KiB/s, maxb=5,689KiB/s, mint=18430msec, maxt=18969msec
  WRITE: io=253MiB, aggrb=22,121KiB/s, minb=0KiB/s, maxb=8,330KiB/s, mint=18430msec, maxt=18969msec

Disk stats (read/write):
  sda: ios=3064/2127, merge=1134/46771, ticks=63868/1360212, in_queue=1424080, util=95.55%
2.60user 1.34system 0:22.49elapsed 17%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2476minor)pagefaults 0swaps