WimMark I Benchmarks


WimMark I is a rough benchmark we have been running here at Oracle against various kernels. Each run tests an OLTP workload on the Oracle database with somewhat restrictive memory conditions. This reduces in-memory buffering of data, allowing for more I/O. The I/O is read and sync write, random and seek-laden. The runs all do ramp-up work to populate caches and the like.

The benchmark is called "WimMark I" because it has no official standing and is only a relative benchmark useful for comparing kernel changes. The benchmark is normalized an arbitrary kernel, which scores 1000.0. All other numbers are relative to this. A bigger number is a better number. All things being equal, a delta < 50 is close to unimportant, and a delta < 20 is very identical.

This benchmark is sensitive to random system events. I run three runs because of this. If two runs are nearly identical and the remaining run is way off, that run should probably be ignored (it is often a low number, signifying that something on the system impacted the benchmark).

The machine in question is a 4 way 700 MHz Xeon machine with 2GB of RAM. CONFIG_HIGHMEM4GB is selected. The disk accessed for data is a 10K RPM U2W SCSI of similar vintage. The data files are living on an ext3 filesystem. Unless mentioned, all runs are on this machine (variation in hardware would indeed change the benchmark).


Kernel Variation Results
2.4.9-e.12smp   1399.60 1602.17 1502.07
2.4.21-pre5   1565.81 1571.72 1521.43
2.5.64   1430.06 1194.90
2.5.64-mm1 deadline 1557.79 1360.52
2.5.64-mm1 anticipatory 547.28 580.69
2.5.64-mm2 deadline 1580.10 1537.95
2.5.64-mm2 anticipatory 632.87 597.33 555.19
2.5.64-mm4 deadline 1655.77 1594.73 1610.91
2.5.64-mm4 anticipatory 1066.70 1291.23
2.5.65-mm1 deadline 1554.48 1589.89 1350.37
2.5.65-mm1 anticipatory 1559.32 1025.38 1579.98
2.5.65-mm2 deadline 1238.58 1537.36 1513.04
2.5.65-mm2 anticipatory 1374.22 1487.19 1437.26
2.5.65-mm4 deadline 1577.62 1596.15 1613.39
2.5.65-mm4 anticipatory 997.99 1404.44 1177.43
2.5.66   1580.45 1079.92 1325.82
2.5.66-mm1 deadline 1221.11 1376.93 1532.29
2.5.66-mm1 anticipatory 1119.58 735.69 879.24
2.5.66-mm3 deadline 1736.51 1681.50 1010.98
2.5.66-mm3 anticipatory 579.62 496.75 517.06
2.5.67   1382.36 1392.28 1378.82
2.5.67-mm3 deadline 1778.54 1656.24 1487.90
2.5.67-mm3 anticipatory 635.58 636.05 592.61
2.5.67-mm4 deadline 1432.42 1074.96 1069.53
2.5.67-mm4 anticipatory 417.42 393.34 437.96
2.5.68   1651.75 1613.27 1427.69
2.5.69   1462.17 1005.78 1995.99
2.5.69-mm1 deadline 1043.80 1153.82 1259.83
2.5.69-mm1 anticipatory 540.90 438.91 409.40
2.5.69-mm3 deadline 1693.54 1648.45 1262.19
2.5.69-mm3 anticipatory 1034.82 831.78 931.18
2.5.69-mjb1   1889.74 1767.44 1816.31
2.5.69-mm5 deadline 1851.49 1439.03 1518.59
2.5.69-mm5 anticipatory 1019.71 904.03 940.38
2.5.69-mm8 deadline 1087.95 1053.95 1043.80 1086.53 1049.23 1097.63
2.5.69-mm8 anticipatory 670.52 967.77 977.69
2.5.70   1005.78 958.80 947.23
2.5.70-mm1 deadline 717.27 1064.57 1089.13
2.5.70-mm1 anticipatory 1342.93 1121.47 1330.42