fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [6.2% done] [  5944/ 83624 kb/s] [eta 00m:45s]
Threads: 3: [mFF] [6.7% done] [     0/ 31924 kb/s] [eta 00m:56s]
Threads: 3: [mFF] [8.3% done] [   812/     0 kb/s] [eta 00m:55s]
Threads: 3: [mFF] [10.0% done] [   828/     0 kb/s] [eta 00m:54s]
Threads: 3: [mFF] [46.7% done] [   780/ 56100 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [47.1% done] [   464/     0 kb/s] [eta 00m:09s]
Threads: 3: [mFF] [45.0% done] [   416/     0 kb/s] [eta 00m:11s]
Threads: 3: [mFF] [45.5% done] [   384/     0 kb/s] [eta 00m:12s]
Threads: 3: [FFF] [100.0% done] [   472/ 32604 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [70.0% done] [  4084/     0 kb/s] [eta 00m:06s]
Threads: 3: [FVV] [71.4% done] [ 24316/     0 kb/s] [eta 00m:06s]
Threads: 3: [FVV] [84.2% done] [ 27924/     0 kb/s] [eta 00m:03s]
Threads: 3: [FVV] [94.4% done] [ 22764/     0 kb/s] [eta 00m:01s]
Threads: 3: [FVV] [100.0% done] [ 25512/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [100.0% done] [ 30332/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [ 26736/     0 kb/s] [eta 00m:10s]
Threads: 2: [V_V] [67.7% done] [ 23240/     0 kb/s] [eta 00m:10s]
Threads: 1: [V__] [84.6% done] [ 27260/     0 kb/s] [eta 00m:04s]
Threads: 1: [V__] [100.0% done] [ 37508/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=2201
  read : io=100MiB, bw=4,345KiB/s, runt= 24128msec
    slat (msec): min=  128, max=13567, avg=11389.93, stdev=3354.31
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=37371, per=78.32%, avg=10210.63, stdev=14779.24
  write: io=88,704KiB, bw=4,530KiB/s, runt= 20051msec
    slat (msec): min=    0, max=  195, avg= 2.59, stdev=13.19
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=83771, per=199.07%, avg=27964.00, stdev=48330.32
  cpu          : usr=4.76%, sys=1.74%, ctx=1006
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2202
  read : io=100MiB, bw=4,972KiB/s, runt= 21089msec
    slat (msec): min=   79, max=18943, avg=15246.82, stdev=3383.12
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=22869, per=88.67%, avg=11560.40, stdev=6186.17
  write: io=95,784KiB, bw=7,248KiB/s, runt= 13532msec
    slat (msec): min=    0, max=   11, avg= 1.82, stdev= 1.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=115046, per=409.50%, avg=57523.00, stdev=81349.81
  cpu          : usr=5.97%, sys=1.82%, ctx=887
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2203
  read : io=100MiB, bw=4,887KiB/s, runt= 21455msec
    slat (msec): min=   69, max=18234, avg=14010.52, stdev=4086.04
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=26976, per=76.94%, avg=10031.22, stdev=6443.24
  write: io=90,580KiB, bw=6,856KiB/s, runt= 13528msec
    slat (msec): min=    0, max=   15, avg= 1.52, stdev= 1.73
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114517, per=407.62%, avg=57258.50, stdev=80975.75
  cpu          : usr=5.54%, sys=1.62%, ctx=1033
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,037KiB/s, minb=4,345KiB/s, maxb=4,972KiB/s, mint=21089msec, maxt=24128msec
  WRITE: io=269MiB, aggrb=14,047KiB/s, minb=4,530KiB/s, maxb=7,248KiB/s, mint=21089msec, maxt=24128msec

Disk stats (read/write):
  sda: ios=3501/2102, merge=1254/66333, ticks=72640/2014328, in_queue=2111524, util=98.51%
3.65user 1.15system 0:24.43elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps