fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [7.7% done] [ 10878/ 29136 kb/s] [eta 00m:36s]
Threads: 3: [mFm] [11.1% done] [  8775/  8672 kb/s] [eta 00m:32s]
Threads: 3: [mFm] [14.7% done] [  8948/     0 kb/s] [eta 00m:29s]
Threads: 3: [mFF] [16.2% done] [  3942/ 30712 kb/s] [eta 00m:31s]
Threads: 3: [mFF] [17.5% done] [  1768/     0 kb/s] [eta 00m:33s]
Threads: 3: [mFF] [18.2% done] [  1134/     0 kb/s] [eta 00m:36s]
Threads: 3: [mFF] [18.8% done] [   712/     0 kb/s] [eta 00m:39s]
Threads: 3: [mFF] [58.8% done] [   701/ 55941 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [57.9% done] [   949/     0 kb/s] [eta 00m:08s]
Threads: 3: [FFF] [100.0% done] [   252/ 14938 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  2103/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [68.0% done] [ 26694/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 23280/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [79.2% done] [ 29896/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.0% done] [ 27057/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.5% done] [ 30542/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 31200/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 28490/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 32149/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=17627
  read : io=100MiB, bw=4,166KiB/s, runt= 25165msec
    slat (msec): min=   79, max=13441, avg=7636.38, stdev=4030.86
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=16800, per=44.44%, avg=5491.14, stdev=4136.77
  write: io=71,988KiB, bw=4,595KiB/s, runt= 16041msec
    slat (msec): min=    0, max=    9, avg= 1.46, stdev= 1.59
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=26918, per=84.28%, avg=13459.00, stdev=19033.90
  cpu          : usr=4.45%, sys=1.35%, ctx=1132
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17628
  read : io=100MiB, bw=4,255KiB/s, runt= 24643msec
    slat (msec): min=   71, max=21576, avg=16727.09, stdev=4978.35
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=19565, per=75.57%, avg=9338.67, stdev=5535.55
  write: io=93,368KiB, bw=5,958KiB/s, runt= 16045msec
    slat (msec): min=    0, max=   12, avg= 1.79, stdev= 2.03
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=34692, per=108.62%, avg=17346.00, stdev=24530.95
  cpu          : usr=4.92%, sys=1.36%, ctx=881
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17629
  read : io=100MiB, bw=4,119KiB/s, runt= 25456msec
    slat (msec): min=   38, max=19373, avg=13696.10, stdev=6062.57
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    8, max=16059, per=51.53%, avg=6367.36, stdev=4799.37
  write: io=84,884KiB, bw=5,418KiB/s, runt= 16041msec
    slat (msec): min=    0, max=  242, avg= 3.50, stdev=18.51
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=102037, per=213.26%, avg=34058.33, stdev=58871.29
  cpu          : usr=4.73%, sys=1.41%, ctx=1083
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,357KiB/s, minb=4,119KiB/s, maxb=4,255KiB/s, mint=24643msec, maxt=25456msec
  WRITE: io=244MiB, aggrb=15,970KiB/s, minb=4,595KiB/s, maxb=5,958KiB/s, mint=24643msec, maxt=25456msec

Disk stats (read/write):
  sda: ios=3890/1793, merge=1489/60734, ticks=89668/1774884, in_queue=1865852, util=99.27%
3.57user 1.07system 0:25.77elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps