Global Management of Cache Hierarchies

Cache memories currently treat all blocks as if they were equally important. This assumption of equallyimportant blocks is not always valid. For instance, not all blocks deserve to be in L1 cache. We thereforepropose globalized block placement. We present a global placement algorithm for managing blocks in a cachehierarchy by deciding where in the hierarchy an incoming block should be placed. Our technique makes decisionsby adapting to access patterns of different blocks.The contributions of this paper are fourfold. First, we motivate our solution by demonstrating the im-portance of a globalized placement scheme. Second, we present a method to categorize cache block behaviorinto one of four categories. Third, we present one potential design exploiting this categorization. Finally, wedemonstrate the performance of our design. The proposed scheme enhances overall system performance (IPC)by an average of 12% over a traditional LRU scheme while reducing traffic between L1 cache and L2 cacheby an average of 20%, using SPEC CPU benchmark suite. All of this is achieved with a table as small as 3KBytes