Design of a parallel vector access unit for sdram memory systems

We are attacking the memory bottleneck by building a “smart ” memory controller that improves effective mem-ory bandwidth, bus utilization, and cache efficiency by let-ting applications dictate how their data is accessed and cached. This paper describes a Parallel Vector Access unit (PVA), the vector memory subsystem that efficiently “gath-ers ” sparse, strided data structures in parallel on a multi-bank SDRAM memory. We have validated our PVA design via gate-level simulation, and have evaluated its perfor-mance via functional simulation and formal analysis. On unit-stride vectors, PVA performance equals or exceeds that of an SDRAM system optimized for cache line fills. On vec-tors with larger strides, the PVA is up to 32.8 times faster. Our design is up to 3.3 times faster than a pipelined, serial SDRAM memory system that gathers sparse vector data, and the gathering mechanism is two to five times faster than in other PVAs with similar goals. Our PVA only slightly in-creases hardware complexity with respect to these other sys-tems, and the scalable design is appropriate for a range of computing platforms, from vector supercomputers to com-modity PCs. 1