fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [33.3% done] [  6896/ 97528 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [33.3% done] [     0/     0 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [33.3% done] [     0/     0 kb/s] [eta 00m:10s]
Threads: 3: [mFF] [33.3% done] [     0/     0 kb/s] [eta 00m:12s]
Threads: 3: [mFF] [33.3% done] [   548/     0 kb/s] [eta 00m:14s]
Threads: 3: [mFF] [33.3% done] [     0/     0 kb/s] [eta 00m:16s]
Threads: 3: [mFF] [33.3% done] [     0/     0 kb/s] [eta 00m:18s]
Threads: 3: [mFF] [33.3% done] [     0/     0 kb/s] [eta 00m:20s]
Threads: 3: [mFF] [33.3% done] [     0/     0 kb/s] [eta 00m:22s]
Threads: 3: [mFF] [34.3% done] [   392/     0 kb/s] [eta 00m:23s]
Threads: 3: [mFF] [34.2% done] [     0/     0 kb/s] [eta 00m:25s]
Threads: 3: [mVF] [66.7% done] [  4092/ 48912 kb/s] [eta 00m:07s]
Threads: 3: [mVF] [68.2% done] [ 15623/    64 kb/s] [eta 00m:07s]
Threads: 3: [mVF] [66.7% done] [ 15604/     0 kb/s] [eta 00m:08s]
Threads: 3: [FVF] [100.0% done] [ 12372/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [100.0% done] [ 12724/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [67.9% done] [ 10428/     0 kb/s] [eta 00m:09s]
Threads: 3: [FVV] [69.0% done] [  9512/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [67.7% done] [ 29424/     0 kb/s] [eta 00m:10s]
Threads: 2: [V_V] [73.3% done] [ 27836/     0 kb/s] [eta 00m:08s]
Threads: 2: [V_V] [82.1% done] [ 29744/     0 kb/s] [eta 00m:05s]
Threads: 2: [V_V] [92.3% done] [ 34677/     0 kb/s] [eta 00m:02s]
Threads: 2: [V_V] [100.0% done] [ 34552/     0 kb/s] [eta 00m:00s]
Threads: 1: [V_E] [100.0% done] [ 30876/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=10968
  read : io=100MiB, bw=3,898KiB/s, runt= 26900msec
    slat (msec): min=    0, max=10397, avg=7167.54, stdev=2941.51
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=25515, per=74.97%, avg=8766.80, stdev=8516.32
  write: io=86,348KiB, bw=4,174KiB/s, runt= 21180msec
    slat (msec): min=    0, max=  765, avg= 4.43, stdev=40.50
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=39690, per=106.36%, avg=14297.00, stdev=22049.15
  cpu          : usr=4.31%, sys=1.52%, ctx=1160
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=10969
  read : io=100MiB, bw=4,849KiB/s, runt= 21623msec
    slat (msec): min=    0, max=18993, avg=14034.24, stdev=4383.14
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    1, max=19923, per=83.65%, avg=9782.44, stdev=6655.77
  write: io=95,948KiB, bw=7,220KiB/s, runt= 13607msec
    slat (msec): min=    0, max=   99, avg= 2.50, stdev= 3.93
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=96550, per=329.72%, avg=44320.33, stdev=48758.53
  cpu          : usr=6.20%, sys=2.05%, ctx=1040
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=10970
  read : io=100MiB, bw=3,962KiB/s, runt= 26460msec
    slat (msec): min=   82, max=23745, avg=19995.36, stdev=4500.37
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=22357, per=92.47%, avg=10813.53, stdev=7066.60
  write: io=95,744KiB, bw=5,208KiB/s, runt= 18822msec
    slat (msec): min=    0, max=   86, avg= 2.35, stdev= 4.54
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=72581, per=181.30%, avg=24370.33, stdev=41752.50
  cpu          : usr=5.14%, sys=1.65%, ctx=1013
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,694KiB/s, minb=3,898KiB/s, maxb=4,849KiB/s, mint=21623msec, maxt=26900msec
  WRITE: io=272MiB, aggrb=13,442KiB/s, minb=4,174KiB/s, maxb=7,220KiB/s, mint=21623msec, maxt=26900msec

Disk stats (read/write):
  sda: ios=3495/3012, merge=1434/66366, ticks=109496/2308580, in_queue=2424384, util=98.95%
3.90user 1.32system 0:27.16elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2424minor)pagefaults 0swaps