fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [5.1% done] [   203/     0 kb/s] [eta 00m:56s]
Threads: 3: [Fmm] [6.7% done] [   349/     0 kb/s] [eta 00m:56s]
Threads: 3: [Fmm] [8.3% done] [   800/    56 kb/s] [eta 00m:55s]
Threads: 3: [Fmm] [10.0% done] [   121/     0 kb/s] [eta 00m:54s]
Threads: 3: [Vmm] [11.7% done] [ 21671/   239 kb/s] [eta 00m:53s]
fio: ioengines.c:195: td_io_queue: Assertion `(io_u->flags & IO_U_F_FLIGHT) == 0' failed.
fio: pid=3610, got signal=6
Threads: 2: [V_m] [13.3% done] [ 12109/ 46803 kb/s] [eta 00m:52s]
Threads: 2: [V_m] [15.0% done] [  1382/     0 kb/s] [eta 00m:51s]
Threads: 2: [V_m] [33.3% done] [ 21850/ 31275 kb/s] [eta 00m:20s]
Threads: 2: [V_m] [57.9% done] [ 32373/ 36213 kb/s] [eta 00m:08s]
Threads: 1: [__m] [57.1% done] [ 26424/     0 kb/s] [eta 00m:09s]
Threads: 1: [__m] [61.9% done] [  3347/     0 kb/s] [eta 00m:08s]
Threads: 1: [__m] [60.9% done] [     8/     0 kb/s] [eta 00m:09s]
Threads: 1: [__m] [60.0% done] [   243/    73 kb/s] [eta 00m:10s]
Threads: 1: [__m] [61.5% done] [   178/     0 kb/s] [eta 00m:10s]
Threads: 1: [__m] [60.7% done] [   251/     0 kb/s] [eta 00m:11s]
Threads: 1: [__m] [62.1% done] [   540/    77 kb/s] [eta 00m:11s]
Threads: 1: [__F] [100.0% done] [  4445/  5713 kb/s] [eta 00m:00s]
Threads: 1: [__V] [76.9% done] [ 13807/     0 kb/s] [eta 00m:06s]
Threads: 1: [__V] [91.3% done] [ 24421/     0 kb/s] [eta 00m:02s]
Threads: 1: [__V] [100.0% done] [ 29614/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=3609
  read : io=100MiB, bw=8,744KiB/s, runt= 11991msec
    clat (msec): min=    0, max=  977, avg=22.89, stdev=80.99
    bw (KiB/s) : min=   13, max=34291, per=197.78%, avg=19057.90, stdev=13003.15
  write: io=100MiB, bw=16,404KiB/s, runt=  6392msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=    5, avg= 0.22, stdev= 0.53
    bw (KiB/s) : min=    0, max=134004, per=469.07%, avg=67002.00, stdev=94755.14
  cpu          : usr=7.31%, sys=3.40%, ctx=4610
  IO depths    : 1=3.8%, 2=58.1%, 4=29.6%, 8=8.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=55.5%, 4=7.8%, 10=12.4%, 20=10.4%, 50=11.2%, 100=2.0%
     lat (msec): 250=0.1%, 500=0.0%, 750=0.2%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=3610
  cpu          : usr=0.00%, sys=0.00%, ctx=0
  IO depths    : 1=0.3%, 2=91.1%, 4=3.5%, 8=5.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=92.3%, 4=1.0%, 10=0.3%, 20=0.0%, 50=0.2%, 100=2.0%
     lat (msec): 250=1.9%, 500=0.3%, 750=0.4%, 1000=0.3%, >=2000=0.6%
fio: (groupid=0): err= 0: pid=3611
  read : io=100MiB, bw=4,630KiB/s, runt= 22625msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 5390, avg=96.74, stdev=366.65
    bw (KiB/s) : min=   23, max=33689, per=55.83%, avg=5379.81, stdev=9439.20
  write: io=75,520KiB, bw=3,965KiB/s, runt= 19500msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1991, avg=10.51, stdev=113.51
    bw (KiB/s) : min=    0, max=32149, per=49.08%, avg=7011.00, stdev=12718.23
  cpu          : usr=2.99%, sys=1.70%, ctx=7479
  IO depths    : 1=1.5%, 2=43.6%, 4=28.7%, 8=26.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=39.4%, 4=2.7%, 10=6.8%, 20=18.5%, 50=21.4%, 100=2.8%
     lat (msec): 250=4.0%, 500=1.5%, 750=0.6%, 1000=0.4%, >=2000=1.0%

Run status group 0 (all jobs):
   READ: io=208MiB, aggrb=9,636KiB/s, minb=0KiB/s, maxb=8,744KiB/s, mint=22625msec, maxt=22625msec
  WRITE: io=266MiB, aggrb=14,284KiB/s, minb=0KiB/s, maxb=16,404KiB/s, mint=22625msec, maxt=22625msec

Disk stats (read/write):
  sda: ios=1613/2870, merge=20/64910, ticks=51916/1691660, in_queue=1747260, util=98.44%
2.34user 1.07system 0:22.96elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2479minor)pagefaults 0swaps