Application-aware Memory System for Fair and Efficient Execution for Concurrent GPGPU Applications

The available computing resources in modern GPUs are growing with each new generation. However, as many gen-eral purpose applications with limited thread-scalability are tuned to take advantage of GPUs, available compute re-sources might not be optimally utilized. To address this, modern GPUs will need to execute multiple kernels simul-taneously. As current generations of GPUs (e.g., NVIDIA Kepler, AMD Radeon) already enable concurrent execution of kernels from the same application, in this paper we ad-dress the next logical step: executing multiple concurrent applications in GPUs. We show that while this paradigm has a potential to improve the overall system performance, negative interactions among concurrently executing applica-tions in the memory system can severely hamper the per