fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [6.4% done] [   996/   157 kb/s] [eta 00m:44s]
Threads: 3: [mFm] [7.1% done] [  1421/     0 kb/s] [eta 00m:52s]
Threads: 3: [mFm] [8.3% done] [   618/   610 kb/s] [eta 00m:55s]
Threads: 3: [mFF] [10.0% done] [     0/ 46922 kb/s] [eta 00m:54s]
Threads: 3: [mFF] [11.7% done] [     0/     0 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [13.3% done] [     0/     0 kb/s] [eta 00m:52s]
Threads: 3: [mFF] [15.0% done] [     0/     0 kb/s] [eta 00m:51s]
Threads: 3: [mVV] [16.7% done] [  1433/     0 kb/s] [eta 00m:50s]
Threads: 3: [mVV] [18.3% done] [ 19570/     0 kb/s] [eta 00m:49s]
Threads: 3: [mVV] [41.4% done] [ 32697/ 48671 kb/s] [eta 00m:17s]
Threads: 3: [FVV] [86.7% done] [ 27556/ 39063 kb/s] [eta 00m:02s]
Threads: 3: [FVV] [93.3% done] [ 21867/     0 kb/s] [eta 00m:01s]
Threads: 3: [FVV] [100.0% done] [ 24253/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [100.0% done] [ 13516/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [100.0% done] [ 19755/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [100.0% done] [ 20101/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_V] [100.0% done] [ 12953/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [76.9% done] [ 15218/     0 kb/s] [eta 00m:06s]
Threads: 1: [V__] [100.0% done] [ 35658/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 34855/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=29451
  read : io=100MiB, bw=4,592KiB/s, runt= 22834msec
    slat (msec): min=   70, max=10129, avg=8419.08, stdev=2140.88
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=40689, per=110.09%, avg=15165.92, stdev=16928.82
  write: io=89,068KiB, bw=4,538KiB/s, runt= 20097msec
    slat (msec): min=    0, max=   10, avg= 1.93, stdev= 1.94
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=105247, per=361.75%, avg=52623.50, stdev=74420.87
  cpu          : usr=5.29%, sys=1.61%, ctx=963
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=29452
  read : io=100MiB, bw=5,606KiB/s, runt= 18703msec
    slat (msec): min=  293, max=17082, avg=12442.24, stdev=2832.07
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   25, max=19286, per=81.03%, avg=11162.07, stdev=5911.19
  write: io=99,876KiB, bw=10,149KiB/s, runt= 10077msec
    slat (msec): min=    0, max=   11, avg= 2.10, stdev= 2.22
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114778, per=394.51%, avg=57389.00, stdev=81160.30
  cpu          : usr=7.04%, sys=2.27%, ctx=864
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=29453
  read : io=100MiB, bw=5,311KiB/s, runt= 19740msec
    slat (msec): min=  158, max=14269, avg=9749.77, stdev=3040.14
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=23040, per=59.61%, avg=8211.37, stdev=6319.94
  write: io=96,568KiB, bw=9,808KiB/s, runt= 10082msec
    slat (msec): min=    0, max=  475, avg= 3.04, stdev=23.59
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=51189, per=117.40%, avg=17077.67, stdev=29541.29
  cpu          : usr=6.50%, sys=1.66%, ctx=978
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,776KiB/s, minb=4,592KiB/s, maxb=5,606KiB/s, mint=18703msec, maxt=22834msec
  WRITE: io=279MiB, aggrb=14,547KiB/s, minb=4,538KiB/s, maxb=10,149KiB/s, mint=18703msec, maxt=22834msec

Disk stats (read/write):
  sda: ios=3228/1797, merge=1317/69349, ticks=101584/1964616, in_queue=2139512, util=97.82%
3.86user 1.15system 0:23.23elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2411minor)pagefaults 0swaps