Software Support Memory Forwarding

Memory forwarding is an effective way to dynamically optimize the data layout. It provides a safe way to improve the performance of cache by actively creating better data locality. The existing memory forwarding mechanism needs additional hardware support to perform the address redirection, which greatly limits its real application. To put the memory forwarding technique into widely practice, we propose a new way of software-based implementation. Based on the fact that good data layout can bring much improvement of cache performance and actual forwarding is a rare event during the execution, our experiment shows that reasonable speedup that can be achieved by using this software-based memory forwarding technique