Superpin: Parallelizing dynamic instrumentation for real-time performance

Dynamic instrumentation systems have proven to be ex-tremely valuable for program introspection, architectural simulation, and bug detection. Yet a major drawback of modern instrumentation systems is that the instrumented applications often execute several orders of magnitude slower than native application performance. In this paper, we present a novel approach to dynamic instrumentation where several non-overlapping slices of an application are launched as separate instrumentation threads and executed in parallel in order to approach real-time performance. A direct implementation of our technique in the Pin dy-namic instrumentation system results in dramatic speedups for various instrumentation tasks – often resulting in order-of-magnitude performance improvements. Our implemen-tation is available as part of the Pin distribution, which has been downloaded over 10,000 times since its release. 1