fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [8.1% done] [ 11149/ 64270 kb/s] [eta 00m:34s]
Threads: 3: [mFF] [8.7% done] [   946/ 65539 kb/s] [eta 00m:42s]
Threads: 3: [mFF] [9.4% done] [  1138/     0 kb/s] [eta 00m:48s]
Threads: 3: [mFF] [10.2% done] [  1059/     0 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [11.7% done] [     0/     0 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [13.3% done] [   881/     0 kb/s] [eta 00m:52s]
Threads: 3: [mFF] [15.0% done] [   858/     0 kb/s] [eta 00m:51s]
Threads: 3: [mFF] [16.7% done] [   586/     0 kb/s] [eta 00m:50s]
Threads: 3: [mVV] [18.3% done] [  3182/     0 kb/s] [eta 00m:49s]
Threads: 3: [mVV] [20.0% done] [ 19701/     0 kb/s] [eta 00m:48s]
Threads: 3: [mVV] [50.0% done] [ 29803/ 52680 kb/s] [eta 00m:13s]
Threads: 3: [mVV] [50.0% done] [ 24729/   129 kb/s] [eta 00m:14s]
Threads: 3: [mVV] [50.0% done] [ 33503/     0 kb/s] [eta 00m:15s]
Threads: 3: [mVV] [50.0% done] [ 32043/     0 kb/s] [eta 00m:16s]
Threads: 3: [mVV] [50.0% done] [ 23990/     0 kb/s] [eta 00m:17s]
Threads: 2: [F_V] [100.0% done] [ 12944/ 26204 kb/s] [eta 00m:00s]
Threads: 1: [F__] [100.0% done] [  7368/     0 kb/s] [eta 00m:00s]
Threads: 1: [F__] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [F__] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [66.7% done] [     0/     0 kb/s] [eta 00m:11s]
Threads: 1: [V__] [85.2% done] [ 24662/     0 kb/s] [eta 00m:04s]
Threads: 1: [V__] [100.0% done] [ 32543/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=1701
  read : io=100MiB, bw=4,117KiB/s, runt= 25467msec
    slat (msec): min=   87, max= 7269, avg=5416.67, stdev=1865.33
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=34146, per=63.65%, avg=7862.27, stdev=12337.75
  write: io=79,736KiB, bw=3,601KiB/s, runt= 22673msec
    slat (msec): min=    0, max= 1103, avg= 2.30, stdev=28.36
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=34063, per=95.10%, avg=11361.33, stdev=19660.22
  cpu          : usr=4.37%, sys=1.45%, ctx=1169
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1702
  read : io=100MiB, bw=5,831KiB/s, runt= 17982msec
    slat (msec): min=   86, max=14417, avg=10653.79, stdev=3454.16
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   25, max=21362, per=84.59%, avg=10448.44, stdev=6519.14
  write: io=89,472KiB, bw=8,352KiB/s, runt= 10969msec
    slat (msec): min=    0, max=   12, avg= 1.73, stdev= 2.01
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114083, per=477.45%, avg=57041.50, stdev=80668.86
  cpu          : usr=6.32%, sys=2.14%, ctx=1020
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1703
  read : io=100MiB, bw=5,436KiB/s, runt= 19289msec
    slat (msec): min=   79, max=16358, avg=11662.00, stdev=3412.64
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=28810, per=84.23%, avg=10404.28, stdev=8508.17
  write: io=95,328KiB, bw=8,902KiB/s, runt= 10965msec
    slat (msec): min=    0, max=   14, avg= 1.87, stdev= 2.07
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=21417, per=89.63%, avg=10708.50, stdev=15144.11
  cpu          : usr=6.20%, sys=2.05%, ctx=939
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,352KiB/s, minb=4,117KiB/s, maxb=5,831KiB/s, mint=17982msec, maxt=25467msec
  WRITE: io=258MiB, aggrb=11,947KiB/s, minb=3,601KiB/s, maxb=8,902KiB/s, mint=17982msec, maxt=25467msec

Disk stats (read/write):
  sda: ios=3717/2191, merge=1211/63619, ticks=73664/1837252, in_queue=1985132, util=98.25%
3.50user 1.16system 0:25.83elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2421minor)pagefaults 0swaps