fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [17.6% done] [   816/ 42609 kb/s] [eta 00m:14s]
Threads: 3: [mFF] [44.4% done] [     0/ 41940 kb/s] [eta 00m:05s]
Threads: 3: [mFF] [45.5% done] [  1524/     0 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [46.2% done] [   568/     0 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [46.7% done] [   300/     0 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [47.1% done] [   980/     0 kb/s] [eta 00m:09s]
Threads: 3: [mFF] [69.2% done] [  1000/ 27008 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [     0/  2992 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [     0/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.2% done] [ 16292/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 31860/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [77.3% done] [ 28868/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.7% done] [ 29408/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.0% done] [ 35892/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 36331/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35852/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30084/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 34020/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=22370
  read : io=100MiB, bw=4,436KiB/s, runt= 23633msec
    slat (msec): min=   70, max=14524, avg=9624.70, stdev=3898.53
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=19574, per=49.44%, avg=6580.00, stdev=5656.23
  write: io=84,556KiB, bw=6,135KiB/s, runt= 14112msec
    slat (msec): min=    0, max=  294, avg= 3.24, stdev=21.54
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=72350, per=116.64%, avg=24149.67, stdev=41742.74
  cpu          : usr=4.99%, sys=1.69%, ctx=1004
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=22371
  read : io=100MiB, bw=4,570KiB/s, runt= 22942msec
    slat (msec): min=13463, max=21997, avg=18464.72, stdev=2694.39
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   16, max=20586, per=81.38%, avg=10831.36, stdev=6442.25
  write: io=100MiB, bw=7,428KiB/s, runt= 14116msec
    slat (msec): min=    0, max=   15, avg= 2.06, stdev= 2.28
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=108560, per=262.17%, avg=54280.00, stdev=76763.51
  cpu          : usr=5.34%, sys=1.78%, ctx=760
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=22372
  read : io=100MiB, bw=4,438KiB/s, runt= 23625msec
    slat (msec): min=   60, max=21438, avg=16447.39, stdev=4034.03
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=20373, per=68.06%, avg=9058.74, stdev=5706.94
  write: io=98,460KiB, bw=7,144KiB/s, runt= 14112msec
    slat (msec): min=    0, max=   67, avg= 2.04, stdev= 3.12
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=96936, per=156.48%, avg=32397.00, stdev=55892.56
  cpu          : usr=5.25%, sys=1.88%, ctx=857
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,310KiB/s, minb=4,436KiB/s, maxb=4,570KiB/s, mint=22942msec, maxt=23633msec
  WRITE: io=279MiB, aggrb=20,704KiB/s, minb=6,135KiB/s, maxb=7,428KiB/s, mint=22942msec, maxt=23633msec

Disk stats (read/write):
  sda: ios=3249/2033, merge=1301/69158, ticks=77904/1803452, in_queue=1892744, util=98.78%
3.69user 1.29system 0:23.96elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2416minor)pagefaults 0swaps