Evaluating the impact of dynamic binary translation systems on hardware cache performance

Dynamic binary translation systems enable a wide range of applications such as program instrumentation, optimization, and security. DBTs use a software code cache to store previ-ously translated instructions. The code layout in the code cache greatly differs from the code layout of the original program. This paper provides an exhaustive analysis of the performance of the instruction/trace cache and other structures of the micro-architecture while executing DBTs that focus on program instr-umentation, such as DynamoRIO and Pin. We performed our evaluation along two axes. First, we di-rectly accessed the hardware performance counters to deter-mine actual cache miss counts. Second, we used simulation to analyze the spatial locality of the translated application. Our re-sults show that when executing an application under the control of Pin or DynamoRIO, the icache miss counts actually increase over 2X. Surprisingly, the L2 cache and the L1 data cache show a much lower performance degradation or even break even with the native application. We also found that overall performance degradations are due to the instructions added by the DBT it-self, and that these extra instructions outweigh any possible spatial locality benefits exhibited in the code cache. Our obser-vations held regardless of the trace length, code cache size, or the presence of a hardware trace cache. These results provide a better understanding of the efficiency of current instrumen-tation tools and their effects on instruction/trace cache perfor-mance and other structures of the microarchitecture. 1