fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [16.7% done] [  7329/ 19160 kb/s] [eta 00m:15s]
Threads: 3: [mFm] [44.4% done] [  5765/ 38754 kb/s] [eta 00m:05s]
Threads: 3: [mFF] [50.0% done] [  4534/ 32111 kb/s] [eta 00m:05s]
Threads: 3: [mFF] [50.0% done] [  1197/     0 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [50.0% done] [   628/     0 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [50.0% done] [   372/     0 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [50.0% done] [   472/     0 kb/s] [eta 00m:09s]
Threads: 3: [mFF] [55.6% done] [   772/  4331 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [55.0% done] [   625/     0 kb/s] [eta 00m:09s]
Threads: 3: [mFF] [54.5% done] [  1016/     0 kb/s] [eta 00m:10s]
Threads: 3: [mFF] [56.5% done] [   996/     0 kb/s] [eta 00m:10s]
Threads: 3: [mFF] [56.0% done] [  1448/     0 kb/s] [eta 00m:11s]
Threads: 3: [FFF] [100.0% done] [   200/ 16980 kb/s] [eta 00m:00s]
fio: ioengines.c:195: td_io_queue: Assertion `(io_u->flags & IO_U_F_FLIGHT) == 0' failed.
fio: pid=9920, got signal=6
Threads: 2: [FV_] [72.7% done] [  8296/     0 kb/s] [eta 00m:06s]
Threads: 2: [FV_] [85.0% done] [ 16460/     0 kb/s] [eta 00m:03s]
Threads: 2: [FV_] [94.7% done] [ 12600/     0 kb/s] [eta 00m:01s]
Threads: 2: [VV_] [67.9% done] [ 27444/     0 kb/s] [eta 00m:09s]
Threads: 2: [VV_] [74.1% done] [ 23792/     0 kb/s] [eta 00m:07s]
Threads: 2: [VV_] [80.8% done] [ 30096/     0 kb/s] [eta 00m:05s]
Threads: 1: [V__] [100.0% done] [ 33580/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=9918
  read : io=100MiB, bw=4,428KiB/s, runt= 23679msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  927, avg=86.75, stdev=159.03
    bw (KiB/s) : min=    0, max=36462, per=53.69%, avg=5191.68, stdev=9168.86
  write: io=79,548KiB, bw=4,352KiB/s, runt= 18716msec
    slat (msec): min=    0, max=    1, avg= 0.00, stdev= 0.03
    clat (msec): min=    0, max=  467, avg= 3.45, stdev=28.41
    bw (KiB/s) : min=    0, max=33610, per=63.97%, avg=9291.25, stdev=16248.50
  cpu          : usr=2.58%, sys=1.77%, ctx=5159
  IO depths    : 1=2.0%, 2=50.3%, 4=28.9%, 8=18.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=44.2%, 4=0.1%, 10=14.9%, 20=16.5%, 50=7.5%, 100=2.6%
     lat (msec): 250=7.5%, 500=4.1%, 750=1.9%, 1000=0.6%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=9919
  read : io=100MiB, bw=4,818KiB/s, runt= 21750msec
    clat (msec): min=    0, max=  381, avg=25.43, stdev=37.81
    bw (KiB/s) : min=   15, max=28429, per=170.02%, avg=16441.27, stdev=7991.55
  write: io=100MiB, bw=6,650KiB/s, runt= 15768msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   18, avg= 0.21, stdev= 0.95
    bw (KiB/s) : min=    0, max=135176, per=465.35%, avg=67588.00, stdev=95583.87
  cpu          : usr=3.70%, sys=2.10%, ctx=5004
  IO depths    : 1=2.6%, 2=59.5%, 4=29.0%, 8=8.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=51.5%, 4=0.3%, 10=16.5%, 20=15.8%, 50=9.5%, 100=2.8%
     lat (msec): 250=3.2%, 500=0.1%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=9920
  cpu          : usr=0.00%, sys=0.00%, ctx=0
  IO depths    : 1=0.4%, 2=85.9%, 4=3.8%, 8=9.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=86.6%, 4=0.4%, 10=0.2%, 20=0.0%, 50=0.5%, 100=3.2%
     lat (msec): 250=6.6%, 500=1.9%, 750=0.2%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=218MiB, aggrb=9,670KiB/s, minb=0KiB/s, maxb=4,818KiB/s, mint=0msec, maxt=23679msec
  WRITE: io=259MiB, aggrb=14,524KiB/s, minb=0KiB/s, maxb=6,650KiB/s, mint=0msec, maxt=23679msec

Disk stats (read/write):
  sda: ios=2761/2598, merge=711/63638, ticks=66468/2326552, in_queue=2398384, util=98.24%
2.09user 1.26system 0:24.01elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2488minor)pagefaults 0swaps