fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8 ... fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8 Starting 3 threads Threads: 3 Threads: 3 Threads: 3: [mmm] [8.8% done] [ 14807/ 7042 kb/s] [eta 00m:31s] Threads: 3: [mmm] [14.3% done] [ 8850/ 11028 kb/s] [eta 00m:24s] Threads: 3: [mmm] [17.9% done] [ 13263/ 3774 kb/s] [eta 00m:23s] Threads: 3: [mmm] [22.2% done] [ 8236/ 9699 kb/s] [eta 00m:21s] Threads: 3: [mmm] [25.9% done] [ 9008/ 6078 kb/s] [eta 00m:20s] Threads: 3: [mmm] [29.6% done] [ 9289/ 6237 kb/s] [eta 00m:19s] Threads: 3: [mmm] [32.1% done] [ 7647/ 7464 kb/s] [eta 00m:19s] Threads: 3: [mmm] [35.7% done] [ 11544/ 3673 kb/s] [eta 00m:18s] Threads: 3: [mmm] [37.9% done] [ 5331/ 8878 kb/s] [eta 00m:18s] Threads: 3: [mmm] [41.4% done] [ 6013/ 8594 kb/s] [eta 00m:17s] Threads: 3: [mmm] [44.8% done] [ 9224/ 3827 kb/s] [eta 00m:16s] Threads: 3: [mmm] [46.7% done] [ 7342/ 6599 kb/s] [eta 00m:16s] Threads: 3: [mmm] [50.0% done] [ 11320/ 36 kb/s] [eta 00m:15s] Threads: 3: [mmm] [51.6% done] [ 9268/ 2698 kb/s] [eta 00m:15s] Threads: 3: [mmm] [54.8% done] [ 6757/ 3128 kb/s] [eta 00m:14s] Threads: 3: [mmm] [56.2% done] [ 9931/ 1036 kb/s] [eta 00m:14s] Threads: 3: [mmm] [59.4% done] [ 7996/ 2190 kb/s] [eta 00m:13s] Threads: 3: [mmm] [62.5% done] [ 4620/ 5798 kb/s] [eta 00m:12s] Threads: 3: [mmm] [63.6% done] [ 8305/ 195 kb/s] [eta 00m:12s] Threads: 3: [mmm] [66.7% done] [ 8943/ 0 kb/s] [eta 00m:11s] Threads: 3: [VVV] [69.7% done] [ 17111/ 369 kb/s] [eta 00m:10s] Threads: 3: [VVV] [72.7% done] [ 19000/ 0 kb/s] [eta 00m:09s] Threads: 3: [VVV] [75.8% done] [ 18289/ 0 kb/s] [eta 00m:08s] Threads: 3: [VVV] [78.8% done] [ 19269/ 0 kb/s] [eta 00m:07s] Threads: 3: [VVV] [84.4% done] [ 19240/ 0 kb/s] [eta 00m:05s] Threads: 2: [EVV] [90.3% done] [ 17737/ 0 kb/s] [eta 00m:03s] fio: (groupid=0): err= 0: pid=318 read : io=100MiB, bw=3,738KiB/s, runt= 28046msec slat (msec): min= 0, max= 5973, avg=1351.58, stdev=2086.48 clat (msec): min= 2, max= 834, avg=91.30, stdev=96.91 bw (KiB/s) : min= 38, max=18215, per=37.92%, avg=4163.63, stdev=3274.90 write: io=35,104KiB, bw=1,624KiB/s, runt= 22127msec slat (msec): min= 0, max= 12, avg= 0.14, stdev= 0.91 clat (msec): min= 0, max= 896, avg=109.64, stdev=132.14 bw (KiB/s) : min= 0, max= 6361, per=42.54%, avg=2389.68, stdev=1985.35 cpu : usr=3.29%, sys=0.17%, ctx=1884 IO depths : 1=0.1%, 2=0.2%, 4=11.9%, 8=87.7%, 16=0.0%, 32=0.0%, >=64=0.0% lat (msec): 2=0.5%, 4=0.7%, 10=4.3%, 20=13.6%, 50=24.9%, 100=20.0% lat (msec): 250=28.0%, 500=6.6%, 750=0.8%, 1000=0.4%, >=2000=0.0% fio: (groupid=0): err= 0: pid=319 read : io=100MiB, bw=3,690KiB/s, runt= 28416msec slat (msec): min= 0, max= 7492, avg=1308.65, stdev=2092.89 clat (msec): min= 0, max= 742, avg=88.56, stdev=87.46 bw (KiB/s) : min= 84, max=14786, per=37.88%, avg=4159.34, stdev=3046.36 write: io=41,280KiB, bw=2,020KiB/s, runt= 20918msec slat (msec): min= 0, max= 2, avg= 0.06, stdev= 0.28 clat (msec): min= 0, max= 958, avg=120.67, stdev=123.50 bw (KiB/s) : min= 0, max= 8646, per=50.69%, avg=2847.27, stdev=2430.85 cpu : usr=3.21%, sys=0.23%, ctx=1818 IO depths : 1=0.1%, 2=0.3%, 4=12.8%, 8=86.7%, 16=0.0%, 32=0.0%, >=64=0.0% lat (msec): 2=0.5%, 4=0.7%, 10=2.9%, 20=10.5%, 50=24.0%, 100=26.9% lat (msec): 250=27.1%, 500=6.4%, 750=0.7%, 1000=0.2%, >=2000=0.0% fio: (groupid=0): err= 0: pid=320 read : io=100MiB, bw=3,660KiB/s, runt= 28648msec slat (msec): min= 0, max= 6989, avg=1173.15, stdev=2090.66 clat (msec): min= 0, max= 841, avg=95.20, stdev=85.27 bw (KiB/s) : min= 134, max=14344, per=36.26%, avg=3981.43, stdev=2749.56 write: io=44,996KiB, bw=2,128KiB/s, runt= 21644msec slat (msec): min= 0, max= 8, avg= 0.18, stdev= 0.83 clat (msec): min= 0, max= 914, avg=125.44, stdev=124.54 bw (KiB/s) : min= 0, max=11492, per=68.45%, avg=3844.64, stdev=3150.24 cpu : usr=2.97%, sys=0.35%, ctx=1882 IO depths : 1=0.1%, 2=0.2%, 4=9.9%, 8=89.8%, 16=0.0%, 32=0.0%, >=64=0.0% lat (msec): 2=2.0%, 4=0.4%, 10=2.4%, 20=7.4%, 50=22.2%, 100=26.7% lat (msec): 250=31.7%, 500=6.5%, 750=0.4%, 1000=0.3%, >=2000=0.0% Run status group 0 (all jobs): READ: io=300MiB, aggrb=10,980KiB/s, minb=3,660KiB/s, maxb=3,738KiB/s, mint=28046msec, maxt=28648msec WRITE: io=119MiB, aggrb=5,617KiB/s, minb=1,624KiB/s, maxb=2,128KiB/s, mint=28046msec, maxt=28648msec Disk stats (read/write): sda: ios=5076/1864, merge=1401/413, ticks=490204/267732, in_queue=757936, util=99.56% 2.74user 0.32system 0:28.94elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k 0inputs+0outputs (0major+2395minor)pagefaults 0swaps