Quantitative Analysis on Caching Effect of I-Structure Data in Frame-Based Mulltithreaded Processing

Since long latency due to remote memory access could be tolerated by rapidly switching to another thread in multithreaded processing, caching I-structure data is ex-pected to have less benejicial effect on the pe$ormance than caching ordinary data. In this papel; we show that caching I-structure data could improve the overall perfor-mance in spite of latency tolerating property of multithread-ing. Our quantitative analysis reveals that the most impor-tant caching effect of I-structure data in frame-based mul-tithreading is the enhancement of frame parallelism. It re-duces the idle time due to latency by lowering latency sensi-tivity and at the same time decreases the thread processing time by exploiting more processors. 1