fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [42.9% done] [  8480/ 10056 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [  1408/ 77224 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [68.8% done] [   484/     0 kb/s] [eta 00m:05s]
Threads: 3: [FFV] [75.0% done] [ 12260/     0 kb/s] [eta 00m:04s]
Threads: 3: [FFV] [81.2% done] [  9164/     0 kb/s] [eta 00m:03s]
Threads: 3: [FFV] [87.5% done] [  8792/     0 kb/s] [eta 00m:02s]
Threads: 3: [FFV] [100.0% done] [ 12760/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [100.0% done] [  7736/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [100.0% done] [  5016/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [ 22092/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [73.1% done] [ 28788/     0 kb/s] [eta 00m:07s]
Threads: 2: [VVE] [74.1% done] [ 24804/     0 kb/s] [eta 00m:07s]
Threads: 2: [VV_] [91.3% done] [ 29706/     0 kb/s] [eta 00m:02s]
Threads: 2: [VV_] [100.0% done] [ 36260/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [100.0% done] [ 29964/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [100.0% done] [ 32328/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=13713
  read : io=100MiB, bw=4,207KiB/s, runt= 24920msec
    slat (msec): min=   59, max=21301, avg=17135.55, stdev=5469.84
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=22391, per=80.76%, avg=10193.76, stdev=7966.97
  write: io=92,328KiB, bw=5,347KiB/s, runt= 17679msec
    slat (msec): min=    0, max=  128, avg= 1.98, stdev= 4.94
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=87449, per=181.86%, avg=29168.33, stdev=50472.55
  cpu          : usr=5.02%, sys=1.17%, ctx=1044
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13714
  read : io=100MiB, bw=4,240KiB/s, runt= 24730msec
    slat (msec): min=   73, max=21430, avg=16922.30, stdev=5602.27
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=23235, per=83.11%, avg=10490.83, stdev=7369.48
  write: io=90,428KiB, bw=5,238KiB/s, runt= 17675msec
    slat (msec): min=    0, max=   13, avg= 2.02, stdev= 2.22
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=23741, per=74.01%, avg=11870.50, stdev=16787.42
  cpu          : usr=4.85%, sys=1.49%, ctx=1029
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13715
  read : io=100MiB, bw=5,156KiB/s, runt= 20334msec
    slat (msec): min=   65, max=18318, avg=13470.24, stdev=3761.23
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    8, max=26571, per=72.21%, avg=9114.95, stdev=6265.06
  write: io=94,164KiB, bw=8,948KiB/s, runt= 10775msec
    slat (msec): min=    0, max=   16, avg= 1.74, stdev= 1.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=115799, per=360.99%, avg=57899.50, stdev=81882.26
  cpu          : usr=6.18%, sys=1.61%, ctx=922
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,623KiB/s, minb=4,207KiB/s, maxb=5,156KiB/s, mint=20334msec, maxt=24920msec
  WRITE: io=270MiB, aggrb=16,039KiB/s, minb=5,238KiB/s, maxb=8,948KiB/s, mint=20334msec, maxt=24920msec

Disk stats (read/write):
  sda: ios=3504/1929, merge=1312/67048, ticks=73036/2098600, in_queue=2218288, util=98.72%
3.76user 1.00system 0:25.37elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2416minor)pagefaults 0swaps