fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [7.3% done] [  2746/ 54176 kb/s] [eta 00m:38s]
Threads: 3: [FFm] [8.0% done] [   890/ 35670 kb/s] [eta 00m:46s]
Threads: 3: [FFm] [8.3% done] [   563/     0 kb/s] [eta 00m:55s]
Threads: 3: [FFm] [10.0% done] [  1252/     0 kb/s] [eta 00m:54s]
Threads: 3: [FFm] [11.7% done] [   996/     0 kb/s] [eta 00m:53s]
Threads: 3: [FFm] [13.3% done] [  1693/     0 kb/s] [eta 00m:52s]
Threads: 3: [FFm] [15.0% done] [  1090/     0 kb/s] [eta 00m:51s]
Threads: 3: [FFm] [16.7% done] [  1090/     0 kb/s] [eta 00m:50s]
Threads: 3: [FVm] [40.7% done] [  3194/ 41267 kb/s] [eta 00m:16s]
Threads: 3: [VVm] [48.0% done] [ 28179/ 10775 kb/s] [eta 00m:13s]
Threads: 3: [VVF] [81.2% done] [ 25351/ 28766 kb/s] [eta 00m:03s]
Threads: 3: [VVF] [93.3% done] [ 24717/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVF] [93.8% done] [ 25395/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVF] [100.0% done] [ 19613/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVF] [100.0% done] [ 26364/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_F] [100.0% done] [ 26635/     0 kb/s] [eta 00m:00s]
Threads: 1: [__F] [100.0% done] [ 14507/     0 kb/s] [eta 00m:00s]
Threads: 1: [__F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [__F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [78.6% done] [ 16588/     0 kb/s] [eta 00m:06s]
Threads: 1: [__V] [100.0% done] [ 29764/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [100.0% done] [ 30433/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=3036
  read : io=100MiB, bw=5,400KiB/s, runt= 19418msec
    slat (msec): min=  112, max=16148, avg=12149.62, stdev=3507.69
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=19313, per=80.27%, avg=10159.89, stdev=6073.87
  write: io=92,844KiB, bw=8,285KiB/s, runt= 11475msec
    slat (msec): min=    0, max=  280, avg= 2.51, stdev=14.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=74213, per=319.78%, avg=41792.00, stdev=37983.60
  cpu          : usr=6.06%, sys=1.81%, ctx=968
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=3037
  read : io=100MiB, bw=5,686KiB/s, runt= 18439msec
    slat (msec): min=10253, max=17522, avg=13751.94, stdev=2271.48
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   20, max=29173, per=105.76%, avg=13385.64, stdev=7539.77
  write: io=100MiB, bw=9,629KiB/s, runt= 10889msec
    slat (msec): min=    0, max=   11, avg= 1.87, stdev= 2.01
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=115186, per=440.68%, avg=57593.00, stdev=81448.80
  cpu          : usr=6.92%, sys=1.87%, ctx=750
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=3038
  read : io=100MiB, bw=4,219KiB/s, runt= 24852msec
    slat (msec): min=  101, max=12206, avg=9764.50, stdev=3391.22
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=35396, per=67.58%, avg=8554.10, stdev=12308.51
  write: io=82,072KiB, bw=3,868KiB/s, runt= 21727msec
    slat (msec): min=    0, max=  407, avg= 2.77, stdev=21.12
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=59928, per=154.39%, avg=20176.67, stdev=34426.98
  cpu          : usr=4.57%, sys=1.42%, ctx=1138
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,657KiB/s, minb=4,219KiB/s, maxb=5,686KiB/s, mint=18439msec, maxt=24852msec
  WRITE: io=271MiB, aggrb=13,069KiB/s, minb=3,868KiB/s, maxb=9,629KiB/s, mint=18439msec, maxt=24852msec

Disk stats (read/write):
  sda: ios=3465/2410, merge=965/66591, ticks=69144/2523948, in_queue=2648596, util=98.55%
3.65user 1.08system 0:25.12elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps