fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8 ... fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8 Starting 3 threads Threads: 3 Threads: 3 Threads: 3: [mmm] [10.0% done] [ 10909/ 8125 kb/s] [eta 00m:27s] Threads: 3: [mmm] [14.8% done] [ 4470/ 16080 kb/s] [eta 00m:23s] Threads: 3: [mmm] [18.5% done] [ 9582/ 8621 kb/s] [eta 00m:22s] Threads: 3: [mmm] [23.1% done] [ 15824/ 1264 kb/s] [eta 00m:20s] Threads: 3: [mmm] [26.9% done] [ 10212/ 4324 kb/s] [eta 00m:19s] Threads: 3: [mmm] [29.6% done] [ 9408/ 5123 kb/s] [eta 00m:19s] Threads: 3: [mmm] [34.6% done] [ 11858/ 3087 kb/s] [eta 00m:17s] Threads: 3: [mmm] [37.0% done] [ 11724/ 3335 kb/s] [eta 00m:17s] Threads: 3: [mmm] [40.7% done] [ 9475/ 6006 kb/s] [eta 00m:16s] Threads: 3: [mmm] [44.4% done] [ 9373/ 4556 kb/s] [eta 00m:15s] Threads: 3: [mmm] [46.4% done] [ 7101/ 5458 kb/s] [eta 00m:15s] Threads: 3: [mmm] [50.0% done] [ 7447/ 6140 kb/s] [eta 00m:14s] Threads: 3: [mmm] [53.6% done] [ 5474/ 6620 kb/s] [eta 00m:13s] Threads: 3: [mmm] [55.2% done] [ 6793/ 3737 kb/s] [eta 00m:13s] Threads: 3: [mmm] [56.7% done] [ 9042/ 1973 kb/s] [eta 00m:13s] Threads: 3: [mmm] [60.0% done] [ 3123/ 6817 kb/s] [eta 00m:12s] Threads: 3: [mmm] [63.3% done] [ 9905/ 35 kb/s] [eta 00m:11s] Threads: 3: [mmm] [64.5% done] [ 8113/ 1587 kb/s] [eta 00m:11s] Threads: 3: [mmm] [65.6% done] [ 6656/ 3115 kb/s] [eta 00m:11s] Threads: 3: [VVV] [71.0% done] [ 15682/ 1697 kb/s] [eta 00m:09s] Threads: 3: [VVV] [74.2% done] [ 18400/ 0 kb/s] [eta 00m:08s] Threads: 3: [VVV] [77.4% done] [ 18762/ 0 kb/s] [eta 00m:07s] Threads: 3: [VVV] [80.6% done] [ 19688/ 0 kb/s] [eta 00m:06s] Threads: 2: [VVE] [87.1% done] [ 20791/ 0 kb/s] [eta 00m:04s] fio: (groupid=0): err= 0: pid=3506 read : io=100MiB, bw=3,757KiB/s, runt= 27906msec slat (msec): min= 0, max= 6173, avg=1478.91, stdev=2073.21 clat (msec): min= 0, max= 588, avg=90.43, stdev=83.56 bw (KiB/s) : min= 48, max= 9252, per=34.03%, avg=3835.34, stdev=2806.61 write: io=42,812KiB, bw=2,003KiB/s, runt= 21884msec slat (msec): min= 0, max= 9, avg= 0.12, stdev= 0.68 clat (msec): min= 0, max= 920, avg=98.25, stdev=119.90 bw (KiB/s) : min= 0, max= 9414, per=45.37%, avg=2382.63, stdev=2365.27 cpu : usr=3.15%, sys=0.19%, ctx=1820 IO depths : 1=0.1%, 2=0.4%, 4=17.2%, 8=82.3%, 16=0.0%, 32=0.0%, >=64=0.0% lat (msec): 2=1.8%, 4=0.9%, 10=4.8%, 20=13.9%, 50=21.6%, 100=21.6% lat (msec): 250=28.3%, 500=6.2%, 750=0.6%, 1000=0.1%, >=2000=0.0% fio: (groupid=0): err= 0: pid=3507 read : io=100MiB, bw=3,777KiB/s, runt= 27759msec slat (msec): min= 0, max= 6466, avg=1315.90, stdev=2092.44 clat (msec): min= 0, max= 502, avg=85.06, stdev=75.55 bw (KiB/s) : min= 28, max=11000, per=38.39%, avg=4326.76, stdev=2750.62 write: io=40,072KiB, bw=1,927KiB/s, runt= 21286msec slat (msec): min= 0, max= 8, avg= 0.15, stdev= 0.74 clat (msec): min= 0, max= 828, avg=124.51, stdev=119.00 bw (KiB/s) : min= 0, max= 7119, per=52.05%, avg=2733.85, stdev=1969.96 cpu : usr=3.30%, sys=0.22%, ctx=1814 IO depths : 1=0.2%, 2=0.3%, 4=14.4%, 8=85.2%, 16=0.0%, 32=0.0%, >=64=0.0% lat (msec): 2=0.4%, 4=0.4%, 10=3.1%, 20=10.9%, 50=23.9%, 100=25.6% lat (msec): 250=29.4%, 500=5.6%, 750=0.4%, 1000=0.2%, >=2000=0.0% fio: (groupid=0): err= 0: pid=3508 read : io=100MiB, bw=3,905KiB/s, runt= 26850msec slat (msec): min= 0, max= 5299, avg=790.85, stdev=1480.12 clat (msec): min= 6, max= 693, avg=95.41, stdev=82.05 bw (KiB/s) : min= 143, max= 8254, per=36.83%, avg=4151.14, stdev=2314.09 write: io=29,376KiB, bw=1,401KiB/s, runt= 21462msec slat (msec): min= 0, max= 2, avg= 0.05, stdev= 0.26 clat (msec): min= 1, max= 819, avg=122.74, stdev=114.38 bw (KiB/s) : min= 0, max= 6829, per=46.65%, avg=2449.82, stdev=2056.75 cpu : usr=3.10%, sys=0.25%, ctx=1782 IO depths : 1=0.1%, 2=0.2%, 4=10.4%, 8=89.3%, 16=0.0%, 32=0.0%, >=64=0.0% lat (msec): 2=0.1%, 4=0.1%, 10=1.7%, 20=9.2%, 50=22.0%, 100=28.1% lat (msec): 250=32.0%, 500=5.8%, 750=0.8%, 1000=0.0%, >=2000=0.0% Run status group 0 (all jobs): READ: io=300MiB, aggrb=11,272KiB/s, minb=3,757KiB/s, maxb=3,905KiB/s, mint=26850msec, maxt=27906msec WRITE: io=110MiB, aggrb=5,252KiB/s, minb=1,401KiB/s, maxb=2,003KiB/s, mint=26850msec, maxt=27906msec Disk stats (read/write): sda: ios=4958/1847, merge=1417/274, ticks=463432/242500, in_queue=705932, util=99.54% 2.68user 0.21system 0:28.22elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k 0inputs+0outputs (0major+2394minor)pagefaults 0swaps