Newton: Computer system improvement through comparative macroperformance analysis

In recent years, computer systems with complex architectural features have been designed and built without a complete understanding of the performance impact of the features. All current systems with complex architectures deliver only a small fraction of their theoretical peak performance on all but the most ideal problems. We believe comparative system analysis and design can greatly enhance the process of computer system macroperformance improvement by allowing each system's designers to focus on those aspects in which their system is substantially weaker than other systems.In this thesis, we present Newton, a philosophy and methodology for comparative analysis and improvement of computer systems. The basic methodology may be broken into three phases. First, models for each of multiple computer systems are developed; the models allocate measured running time to system components. Second, the original measurements or the running-time allocations for multiple systems are compared to detect and isolate performance problem. Finally, predictions are made of the performance improvement that will be realized if a discovered performance problem is alleviated.For research into this methodology, software has been written which automates many aspects of the methodology, and it has been used to build models for an Alliant FX/80, a Convex C240, and the CSRD Cedar. The models are shown to represent the systems accurately in most cases. The prototype was also used to compare pairs of these systems and to predict what performance changes would be realized if various hardware and software changes were made. Verification studies indicate that these predictions are quite accurate.When analyzing complex systems, the amount of data to examine can easily obscure the desired information. The Newton methodology has shown itself to be an effective filter for finding aspects of each system that are truly relevant to performance by quantifying the degree to which each aspect is a bottleneck to increased performance. The philosophy of comparative analysis, such as that implemented by Newton, is clearly a valuable tool for performance evaluation and improvement, although the methodology requires further development for practical use in the design and improvement of computer systems.U of I OnlyETDs are only available to UIUC Users without author permissio